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Networks 


Flow  Control 


v  A  joint  flow  control  and  routing  (JFCR)  strategy  is  proposed  for  store  and 
forward  communication  networks.  The  strategy  is  based  on  a  convex  optimiza¬ 
tion  problem  in  terms  of  the  average  input  rates  and  multi-commodity  flows 
and  is  shown  to  have  the  following  properties:  First  the  average  load  of 
each  buffer  stays  below  some  arbitrarily  chosen  level  for  the  input  rate  and 
routing  assignments  of  the  strategy.  This  level  can  be  chosen  so  as  to  upper 
bound  the  probability  of  buffer  overflow  arbitrarily.  Secondly,  by  proper 
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selection  of  the  cost  function,  it  is  possible  to  utilize  the  network  fully 
and  to  achieve  a  variety  of  different  types  of  priorities  in  the  services 
offered  to  the  users.  Finally,  the  routing  assignments  of  the  strategy  cor¬ 
respond  to  a  routing  strategy  which  tends  to  minimize  the  total  delay  when 
the  network  is  lightly  loaded  and  tends  to  prevent  congestion  when  it  is 
heavily  loaded.  Furthermore,  the  proposed  JFCR  problem  is  shown  to  be  equi¬ 
valent  to  a  minimum  delay  routing  problem  corresponding  to  a  "bigger  network. 
Accordingly,  any  minimum  delay  routing  algorithm  can  be  converted  into  a 
JFCR  algorithm.  Using  this  approach,  a  class  of  JFCR  algorithms  with  distri¬ 
buted  computations  at  the  nodes  are  developed. 

Under  certain  conditions,  a  one  to  one  correspondence  is  shown  to  exist 
in  a  store  and  forward  network  between  the  set  of  average  input  rates  and 
the  set  of  average  number  of  outstanding  packets  of  commodities.  This  unique 
correspondence  is  used  to  show  that  in  practice  the  average  input  rates  can 
be  adjusted  as  desired  by  restricting  the  number  of  outstanding  packets  on 
each  commodity  (window  strategy).  It  is  further  shown  that  the  upper  bounds 
(windown  sizes)  corresponding  to  each  set  of  input -rate  assignments  can  be 
computed  distributive^  in  the  network. 

If  a  sufficiently  fast  algorithm  with  frequent  updates  is  employed,  the 
■  JFCR  strategy  can  cope  with  quasi-static  variations  of  the  load  offered  to 
the  network.  On  the  other  hand  the  window  strategy  is  effective  in  control¬ 
ling  the  dynamic  fluctuations  of  the  traffic.  Thus  the  analytical  features 
and  quasi-static  effectiveness  of  the  JFCR  strategy  is  combined  with  the  fast 
dynamics  and  practicality  of  the  windo^r  strategy. 
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ABSTRACT 

A  joint  flow  control  and  routing  (JFCR)  strategy  is  proposed  for  store 
and  forward  communication  networks.  The  strategy  is  based  on  a  convex  opti¬ 
mization  problem  in  terms  of  the  average  input  rates  and  multi-commodity 
flows  and  is  shown  to  have  the  following  properties:  First  the  average  load 
of  each  buffer  stays  below  some  arbitrarily  chosen  level  for  the  input  rate 
and  routing  assignments  of  the  strategy.  This  level  can  be  chosen  so  as  to 
upper  bound  the  probability  of  buffer  overflow  arbitrarily.  Secondly,  by 
proper  selection  of  the  cost  function,  it  is  possible  to  utilize  the  network 
fully  and  to  achieve  a  variety  of  different  types  of  priorities  in  the  serv¬ 
ices  offered  to  the  users.  Finally,  the  routing  assignments  of  the  strategy 
correspond  to  a  routing  strategy  which  tends  to  minimize  the  total  delay  when 
the  network  is  lightly  loaded  and  tends  to  prevent  congestion  when  it  is 
heavily  loaded.  Furthermore,  the  proposed  JFCR  problem  is  shown  to  be  equi¬ 
valent  to  a  minimum  delay  routing  problem  corresponding  to  a  bigger  network. 
Accordingly,  any  minimum  delay  routing  algorithm  can  be  converted  into  a 
JFCR  algorithm.  Using  this  approach,  a  class  of  JFCR  algorithms  with  distri¬ 
buted  computations  at  the  nodes  are  developed. 

Under  certain  conditions,  a  one  to  one  correspondence  is  shown  to  exist 
in  a  store  and  forward  network  between  the  set  of  average  input  rates  and  the 
set  of  average  number  of  outstanding  packets  of  commodities.  This  unique 
correspondence  is  used  to  show  that  in  practice  the  average  input  rates  can 
be  adjusted  as  desired  by  restricting  the  number  of  outstanding  packets  on 
each  commodity  (window  strategy).  It  is  further  shown  that  the  upper  bounds 
(window  sizes)  corresponding  to  each  set  of  input  rate  assignments  can  be 
computed  distributively  in  the  network. 

If  a  sufficiently  fast  algorithm  with  frequent  updates  is  employed,  the 
JFCR  strategy  can  cope  with  quasi-static  variations  of  the  load  offered  to  the 
network.  On  the  other  hand  the  window  strategy  is  effective  in  controlling 
the  dynamic  fluctuations  of  the  traffic.  Thus  the  analytical  features  and 
quasi-static  effectiveness  of  the  JFCR  strategy  is  combined  with  the  fast 
dynamics  and  practicality  of  the  window  strategy. 
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CHAPTER  I 


INTRODUCTION 


1.1  Description  of  the  Problem 

In  a  store  and  forward  (S/F)  data  communication  network,  each  node  is 
equipped  with  some  storage  capacity,  called  a  buffer.  The  messages  arriving 
at  each  node  will  be  queued  in  this  buffer  and  wait  until  they  can  be  trans¬ 
mitted  over  an  appropriate  outgoing  communication  link.  As  in  the  case  of  a 
single  server,  the  sizes  of  the  queues  built  up  in  the  buffers  depend  on  the 
rate  of  the  traffic  seeking  service  by  the  network.  As  the  rate  of  arriving 
traffic  increases,  these  queues  also  will  grow  in  size  and  the  messages  will 
undergo  larger  delays  when  passing  through  the  network.  Since  the  nodal  sto¬ 
rages  are  limited  in  size,  if  the  input  rates  continue  to  increase,  eventual¬ 
ly  some  of  the  buffers  will  become  congested  by  the  stored  data. 

When  congestion  occurs,  i.e.  when  some  of  the  buffers  of  the  network 
get  congested  with  the  data  waiting  for  available  links,  the  efficiency  of 
the  network  drops  since  those  links  which  lead  to  saturated  buffers  can  no 
longer  send  data.  Therefore,  in  this  situation,  an  increase  in  arrival  rate 
leads  to  a  decrease  in  the  service  rate.  This  is  an  unstable  situation  and, 
unless  the  inputs  to  the  network  are  reduced  sufficiently,  will  drive  the 
network  more  into  congestion  and  more  buffers  will  become  saturated.  As  the 
number  of  nodes  with  saturated  buffers  increases,  a  situation  known  as  "dead¬ 
lock"  will  occur.  A  deadlock  involves  several  saturated  nodes,  each  one 
filled  up  with  the  data  which  should  be  sent  to  other  saturated  nodes.  In 
effect,  no  transmission  of  data  remains  possible  between  these  nodes  and 
they  will  be  locked  up  to  each  other  unless  some  of  the  buffered  data  is 
dropped  out.  A  deadlock  may  even  involve  all  of  the  nodes  of  the  network. 

The  above  comments  are  roughly  illustrated  in  Fig.  1.1,  where  the 
throughput  of  the  network  is  sketched  versus  the  total  stored  data  in  the 
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buffers.  Although  the  term  "throughput"  here  is  a  vague  notion,  since  it 
could  be  interpreted  either  as  the  sum  of  the  throughput  of  all  commodities 
or  sum  of  the  flow  of  all  the  links,  stillwe  find  this  diagram  useful  in 
demonstrating  what  happens  in  the  network. 


Fig.  1.1 


In  a  well-designed  network,  the  nodal  storag®  and  link  capacities  are 
properly  sized  so  as  to  accomodate  peak  hour  traffic  requirements  and  to  ab¬ 
sorb  reasonable  short-term  fluctuations  within  the  peak  hour.  This  does 
not  guarantee,  however,  that  the  input  traffic  will  never  exceed  the  limits 
of  the  network.  If  controls  are  not  imposed,  a  sufficiently  high  burst  of 
input  traffic  can  always  drive  the  network  into  the  congestion  or  deadlock 
states . 

Adaptive  routing,  flow  control  and  deadlock  prevention  refer  to  three 
types  of  control  schemes  which  are  necessary  in  order  to  maintain  a  small 
delay  and  uncongested  traffic  in  the  network.  A  routing  strategy,  while 
assuming  no  control  over  the  rate  of  arriving  traffic, of ten  tries  to  route 
the  data  through  the  network  with  the  objective  of  minimizing  the  total 
number  of  messages  in  the  network  for  the  given  input  rates.  When  conges¬ 
tion  is  likely  to  occur  in  some  parts  of  the  network,  adaptive  routing  can 
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Provide Some  relief  by  offering  alternate  routes  to  the  data  passing  through 
the  congested  regions.  However,  if  the  input  rates  are  higher  than  the  max¬ 
imum  flows  achievable  by  the  best  routing,  then  congestion  will  still  occur. 

Adequate  control  procedures  must,  therefore,  be  developed  to  regulate 
input  rates  and  prevent  the  network  from  entering  the  congestion  region. 

The  ensemble  of  such  procedures  is  generally  referred  to  as  the  flow  control 
strategy.  In  a  well-designed  network  some  additional  control  means  should 
be  available  to  avoid  deadlock  if  the  flow  control  procedure  does  not  work 
and  the  network  becomes  partially  congested.  This  latter  control  procedure 
is  referred  to  as  a  deadlock  prevention  mechanism.*  Here  in  this  report,  we 
are  only  concerned  with  the  routing  and  flow  control  problems  with  the  em¬ 
phasis  on  the  flow  control.  A  discussion  about  deadlock  prevention  can  be 
found  in  [1],  [2]. 

The  problem  of  routing  has  been  an  active  research  area  in  the  field 
of  data  networks  in  recent  years  and  several  static,  quasi-static  and  dyna¬ 
mic  routing  algorithms  using  central  or  distributed  computations  have  been 
studied  [3]  -  [6].  The  objective  of  most  of  these  algorithms  is  to  minimize 
the  expected  number  of  messages  which  are  in  the  network.  This  is  equivalent 
to  minimizing  the  expected  delay  of  messages  travelling  through  the  network. 
This  type  of  routing  is  called  a  "minimum  delay  routing".  There  is  a  differ¬ 
ent  type  of  routing  problem,  considered  by  J.R.  Yee  [6],  with  the  objective 
of  minimizing  the  congestion  of  the  most  congested  link,  that  is  to  minimize 
the  ratio  of  flow  over  capacity  (f/C)  for  the  link  with  the  biggest  such 
ratio  in  the  network.  This  type  of  routing  is  called  minmax  routing.  Minmax 
routing  currently  appears  to  be  more  difficult  to  implement  than  minimum 
delay  routing.  However,  it  is  probably  more  meaningful  with  respect  to  the 
congestion  problem,  since  it  tries  to  minimize  the  congestion  over  the  worst 


link.  Both  types  of  routing  policies,  however,  frequently  lead  to  very  si¬ 
milar  routing  assignments  [7], 

While  the  routing  problem  is  intensively  studied,  there  is  little  work 
done  in  the  area  of  flow  control.  Our  objective  in  this  research  initially 
was  to  develop  a  flow  control  strategy  for  data  communication  networks .What  we 

came  up  with,  however,  is  a  unified  approach  to  both  routing  and  flow  conrol. 

The  kind  of  congestion  that  we  are  concerned  with  in  our  study  here  is 
the  saturation  of  intermediate  nodes  in  a  S/F  communication  network.  This 
is  sometimes  referred  to  as  store  and  forward  (S/F)  congestion.  There  exists 
a  less  fundamental  kind  of  congestion  in  S/F  networks  where  different 
packets  (sgements)  of  the  same  conversation  may  take  alternate  routes.  These 
packets  must  therefore  be  reassembled  in  the  correct  sequence  before  delive¬ 
ry  to  the  destination.  Deadlock  may  occur  if  the  number  of  outstanding 
packets  exceed  the  size  of  the  reassmbly  buffer.  This  is  known  as  reassembly 
congestion  and  is  less  interesting  conceptually  because  it  is  an  isolated 
problem  involving  only  an  interaction  between  a  source  and  a  destination 
node- For  this  reason  we  focus  on  the  more  general  problem  of  store  and 
forward  congestion  and  by  "flow  control"  we  mean  that  kind  of  control  neces¬ 
sary  to  prevent  it. 

Basically  the  objectives  of  a  flow  control  design  are  as  follows: 

i)  protection  against  congestion; 

ii)  minimum  reduction  of  the  network  throughput  and  minimum 
overhead  in  normal  network  conditions; 

iii)  fairness  with  respect  to  all  network  users. 

✓ 

It  is  important  to  keep  the  second  objective  in  mind  because  otherwise 
one  may  shut  down  all  ports  of  the  network  in  order  to  protect  it  against 
congestion.  The  third  objective  becomes  important  when  a  nework  is  conges- 
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ted  and  it  is  necessary  to  reduce  some  of  the  input  traffics.  The  question 
is  which  conversation  should  be  reduced  first. 

1.2  Historical  Background  and  Previous  Results 

The  problem  of  flow  control  in  S/F  networks  goes  back  to  early  1970's 
when  the  ARPA  network  was  developed  to  demonstrate  the  feasibility  of  S/F 
networks.  Since  then  there  have  been  many  articles  written  on  the  subject 
and  several  examples  of  flow  control  strategies  are  found  in  the  literature, 
a  few  of  which  are  implemented  on  real  networks  [8]  -  [13].  Gerla  and  Chou 
give  an  excellent  summary  and  critique  of  some  of  these  strategies  [14]. 

Most  of  the  proposed  flow  control  strategies  so  far  have  been  ad  hoc  and  de¬ 
spite  the  importance  of  the  subject,  it  appears  that  little  systematic  work 
has  been  done  to  formulate  the  general  problem  and  to  investigate  the  re¬ 
lationship  between  network  congestion  and  other  important  network  functions 
and  parameters  such  as  routing  strategy,  transmission  delay,  buffer  size, 
etc.  However,  some  of  the  suggestions  have  interesting  features.  Here  we 
refer  to  some  of  the  work  done  so  far: 

Perhaps  the  most  direct  forward  flow  control  scheme  is  the  one  proposed 
by  D.W.  Davies  and  simulated  in  National  Physical  Laboratory  (NPL)  UK  [9]. 
Here  the  idea  is  to  keep  the  total  number  of  outstanding  packets  in  the  net¬ 
work  below  some  critical  number  P.  This  can  be  done  by  circulating  P  empties 
(places)  through  the  network.  A  packet  can  enter  the  network  only  if  it  can 
capture  one  of  these  empties.  The  empty  will  be  released  once  the  packet 
is  at  the  destination.  The  method  does  not  prevent  local  congestion,  how¬ 
ever,  since  it  controls  only  the  total  number  of  packets  but  not  the  packet 
distribution  in  the  network.  Proper  distribution  of  the  empties  through 
the  network  in  order  to  maintain  a  fast  and  effective  service  to  the  pack¬ 
ets  waiting  at  the  ports  is  another  critical  problem. 
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Another  strategy  which  appears  to  be  the  best  among  the  existing  ones 
is  the  window  strategy  [14].  Here  the  number  of  outstanding  packets  between 
each  source  and  destination  pair  is  kept  below  a  given  number  called  the 
window  size.  The  window  size  corresponding  to  each  source-destination  pair 
is  usually  fixed  but  might  be  updated  based  on  some  flow  control  table  in¬ 
formation  circulated  in  the  network.  The  proposal  does  not  describe,  how¬ 
ever,  how  the  updating  procedure  could  be  performed.  It  is  worth  noting 
that  even  with  fixed  window  sizes,  this  strategy  provides  some  adaptive  flow 
control  since  the  input  rate  for  each  source-destination  pair  decreases  as 
the  number  of  highly  active  source-destination  pairs  increases .Nevertheless 
this  change  is  not  enough  to  recover  the  normal  performance  of  the  network 
when  it  has  become  congested  because  of  too  many  active  source-destination 
pairs. 

As  examples  of  the  few  analytical  works  done  in  this  area,  we  mention 
two  articles.  The  first  article,  by  Pennoti  and  Schwartz  [11],  considers 
the  effect  of  the  traffic  over  a  set  of  tandem  links  on  the  service  offered 
to  other  conversations  each  of  which  uses  only  a  single  link  out  of  this  set. 
Statistical  analysis  is  then  used  to  evaluate  the  result  of  applying  some 
window  sizes  on  the  internal  traffic.  But  the  analysis  is  limited  to  a 
set  of  tandem  links  rather  than  the  entire  network  and  in  effect  establishes 
only  that  by  reducing  the  input  rate  of  one  commodity,  a  better  service  can 
be  offered  to  the  others. 

A  more  interesting  flow  control  analysis  is  presented  by  Lam  and 
Reiser  [12].  Here  flow  control  is  achieved  by  applying  a  limit  for  every 
node  on  the  percentage  of  the  corresponding  buffer  which  can  be  engaged  by 
packets  entering  the  network  at  that  node  (input  buffer  limits).  Due  to  the 
complexities  involved,  a  statistical  analysis  is  performed  only  for  a  homo- 


geneous  case  in  which  there  is  complete  symmetry  amongst  the  nodes  with 
respect  to  the  number  of  incoming  and  outgoing  links  and  their  capacities, 
the  rate  of  arriving  traffic,  the  routing  parameters  and  the  available 
buffer.  The  throughput  of  the  arriving  traffic  and  the  probability  of 
buffer  overflow  is  then  computed  and  sketched  in  terms  of  the  input  buffer 
limit,  and  a  rule  of  thumb  for  calculating  the  best  input  buffer  limit  is 
suggested. 

The  analysis  is  successful  in  demonstrating  some  of  the  important  tra¬ 
de-offs  such  as  the  trade-off  between  offering  service  to  different  users 
and  the  trade-off  between  increasing  input  traffic  and  decreasing  congestion. 
It  is,  however,  limited  to  a  completely  symmetrical  case  and  also  considers 
a  stationary  traffic,  therefore  does  not  show  how  the  input  buffer  limits 
can  be  updated  in  accordance  with  the  changing  traffic.  Furthermore,  input 
buffer  limits,  while  being  very  simple  to  implement  and  relatively  easy  for 
statistical  analysis,  do  not  seem  to  provide  sufficiently  effective  means 
for  flow  control.  This  is  because  when  some  node  j  is  congested  due 
to  the  traffic  entering  at  node  i,  the  input  at  j  will  be  inhibited, 
but  that  at  the  offending  node  i  is  unaffected. 

1.3  Overview  of  the  Model  and  Results 

A  major  source  of  difficulties  in  almost  all  of  the  previous  attempts 
made  to  formulate  a  flow  control  problem  is  the  statistical  analysis  of  the 
queues  of  the  network,  especially  when  buffers  are  considered  to  be  limited 
in  size.  A  fundamental  question,  therefore,  is  whether  or  not  we  have  to 
introduce  the  statistical  behavior  of  the  network  into  analysis  in  order  to 
derive  some  effective  results.  Another  question  with  respect  to  the  model 
is  the  choice  of  the  flow  control  variables,  namely  the  parameters  which 
should  be  controlled  in  order  to  maintain  an  uncongested  traffic.  Possible 


parameters  are  the  number  of  outstanding  packets,  the  percentage  of  the 
buffers  engaged  by  different  commodities,  or  the  average  input  rates.  Which 
one  of  these,  or  other,  parameters  should  be  considered  as  flow  control 
variables  in  order  to  formulate  the  problem  and/or  achieve  an  effective  flow 
control  in  practice? 

Here, in  the  present  work,  we  have  primarily  avoided  a  statistical 
analysis  of  the  queues  by  formulating  the  problem  in  terms  of  the  average 
quantities  involved,  such  as  the  average  flows  and  the  average  buffer  loads. 
Also,  for  the  purpose  of  theoretical  development  of  the  problem, we  consider 
the  average  input  rates  of  different  commodities  as  our  flow  control  vari¬ 
ables.  After  the  problem  is  formulated  and  solved  and  basic  results  with 
respect  to  the  average  behavior  of  the  network  is  derived,  then  we  are  able 
to  consider  the  statistical  fluctuations  of  the  traffic  as  well  and  also  to 
propose  other  means  of  achieving  flow  control  which  are  more  practical  and 
effective  compared  to  the  control  of  average  input  rates. 

In  Chapter  II,  we  formulate  the  flow  control  problem  together  with 
the  routing  problem  as  a  convex  optimization  in  terms  of  the  average  input 
rates  and  the  average  multi-commodity  flows.  We  shall  refer  to  this  formu¬ 
lation  as  a  joint  flow  control  and  routing  (JFCR)  problem  and  to  the  result¬ 
ing  flow  control  and  routing  policy  as  a  JFCR  strategy.  The  formulation  is 
based  on  a  static  model  for  the  network  where  there  is  a  fixed  set  of  active 
commodities  and  the  statistics  of  these  commodities  are  stationary  in  time. 
Nevertheless, the  strategy  is  shown  to  be  applicable  to  a  quasi-static  situa¬ 
tion  where  both  the  set  of  active  commodities  and  the  statistics  of  these 
commodities  change  gradually  with  time. 

The  fundamental  trade-off  between  offering  service  to  more  traffic 


and  avoiding  congestion  is  embodied  in  the  formulation  by  trading-off 
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between  two  sets  of  cost  functions,  one  set  corresponding  to  the  links  (one 
function  for  each  link)  and  reflecting  the  level  of  congestion,  the  other 
set  corresponding  to  the  commodities  (one  function  for  each  commodity)  and 
reflecting  the  magnitude  of  the  restrictions  imposed. 

The  input  rate  and  the  routing  assignments  of  the  strategy  guarantee 
that  the  load  of  each  buffer  on  the  average  will  remain  under  an  arbitrarily 
chosen  level.  Given  the  statistical  fluctuations  of  the  traffic  and  the 
maximum  available  buffer  at  each  node,  one  can  choose  this  level  so  as  to 
upper  bound  the  probability  of  buffer  overflow  arbitrarily.  The  routing 
assignments  of  the  strategy  correspond  to  what  we  may  call  a  minimum  conges¬ 
tion  routing.  The  minimum  congestion  routing  lies  somewhere  between  the 
minimum  delay  routing  and  the  minmax  routing  and  shares  the  advantages  of 
both  of  them:  Like  the  minimum  delay  routing  it  is  computationally  more 
amenable  while  having  the  congestion  relief  property  of  the  minmax  routing. 

The  cost  functions  corresponding  to  the  commodities  and  the  links  can 
be  arbitrarily  chosen  from  a  wide  class  of  convex  functions.  We  show  in 
Chapter  II  that  by  choosing  appropriate  cost  functions  for  the  commodities, 
it  is  possible  to  achieve  a  variety  of  different  types  of  priorities  in  the 
services  offered  to  the  users.  Specif ically, we  show  that  the  relative  magni¬ 
tude  of  the  input  rate  assignments  to  different  commodities  and  the  relative 
sensitivity  of  these  assignments  with  respect  to  the  changes  in  traffic,  can 
be  widely  modified  by  changing  certain  parameters  in  the  cost  functions. 
Furthermore,  we  show  that  if  the  magnitude  of  the  link  cost  functions  are 
appropriately  chosen,  the  strategy  does  not  go  beyond  the  necessary  magni¬ 
tude  in  confining  the  input  rates,  in  order  to  achieve  flow  control. 

An  important  feature  of  the  proposed  JFCR  strategy  is  that  it  is 
equivalent  to  a  minimum  delay  routing  problem  corresponding  to  a  bigger  net- 
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work.  This  equivalence,  which  is  shown  in  Chapter  III,  allows  us  to  use 
any  one  of  the  algorithms  proposed  for  the  intensively  studied  routing  prob¬ 
lem,  in  order  to  develop  a  JFCR  algorithm.  As  an  example  of  such,  we  have 
used  the  distributed  routing  algorithm  of  R.G.  Gallager  [4]  to  develop  a 
JFCR  algorithm  using  distributed  computations  at  the  nodes  of  the  network. 

Finally  in  Chapter  IV  we  show  that  under  certain  conditions  there 
always  exists  a  unique  correspondence  between  the  set  of  average  input  rates 
of  the  network  on  one  hand  and  the  set  of  average  number  of  outstanding 
packets  of  commodities  on  the  other  hand.  This  unique  correspondence  allows 
us  to  use  the  window  strategy  as  the  means  of  achieving  the  input  rate 
assignments  of  the  JFCR  strategy.  We  further  show  that  the  window  sizes 
corresponding  to  each  set  of  input  rate  assignments  can  be  computed  distri¬ 
butive^  in  the  network.  The  window  strategy  is  effective  in  controlling  the 
fast  fluctuations  of  the  traffic,  a  desired  property  that  the  JFCR  stategy 
lacks.  Thus,  we  are  able  to  combine  the  nice  analytical  features  and  the 
quasi-static  effectiveness  of  the  JFCR  strategy  with  the  fast  dynamics  and 
practicality  of  the  window  strategy. 


CHAPTER  II 


GENERAL  FORMULATION  OF  A  JOINT  FLOW  CONTROL  AND  ROUTING  PROBLEM 

Our  objective  in  this  chapter  is  to  show  how  the  routing  and  the  flow 
control  problems  in  a  data  communication  network  can  be  formulated  together 
as  a  convex  optimization  problem.  In  our  discussion  we  consider  a  store  and 
forward  (S/F)  packet  switching  network.  However,  the  idea  is  quite  general 
and  can  be  used  for  the  design  of  flow  control  strategies  in  other  types 
of  data  communication  networks.  After  the  model  of  the  network  is  discussed, 
we  shall  propose  our  formulation  of  the  flow  control  problem  and  then  shall 
show  that  the  formulation  actually  complies  with  our  expectations  of  a  sen¬ 
sible  flow  control  scheme. 


2.1  The  Model 

Consider  a  S/F  packet  switching  network  with  N  nodes .  Let  W  denote 
the  set  of  nodes  in  the  network: 


N  *  { i 1 i  *  1, . ♦ .N) 

Let  a  link  from  node  i  to  node  k  be  represented  by  (i,k).  In  order  to 
discuss  traffic  flow,  we  distinguish  (i,k)  from  (k,i),  but  assume  that  if 
one  exists,  the  other  one  does  also.  Assume  that  there  exists  at  least  one 
sequence  of  links  connecting  any  two  nodes  in  the  network.  Let  L  be  the 
set  of  the  links  of  the  network: 

L  m  {(i,k)|  a  link  joes  from  i  to  k} 


Let  L  be  the  total  number  of  the  links  in  the  network.  We  will  sometimes 
specify  a  link  with  only  one  subscript  1  *  1,...,L,  Let  denote 
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the  capacity  of  link.  (i>k)  Clink  &), 

In  general  there  may  exist  some  exchange  of  data  between  any  pair  of 
nodes  i  and  j  in  the  network.  We  refer  to  the  stream  of  data  entering 
the  network  at  node  i  and  destined  for  node  j  as  commodit  (i,j).  Clearly 
commodity  (i,j)  is  different  from  commodity  Cj , i) -  Let  C  be  the  set  of 
all  potential  commodities  (or  all  source-destination  pairs)  in  the  network: 

C  -  { (i, j) | i.jeW  ,  i  f  j) 

In  practice,  the  sequence  of  arrivals  of  messages  of  a  given  commodity 
(i,j)  forms  a  random  process  whose  statistics  may  change  from  time  to  time. 
Furthermore,  as  times  goes  on  some  of  the  active  commodities,  namely  those 
that  have  had  some  nonzero  stream  of  data,  may  become  silent  and  some  of  the 
inactive  ones  may  start  transmitting  data.  Although  our  major  interest  is 
in  the  JFCR  strategy  for  a  quasi-static  situation,  for  the  purpose  of  theo¬ 
retical  development  of  the  problem  we  consider  for  the  time  being  a  static 
case  where  the  active  commodities  are  always  active  and  the  silent  ones 
always  stay  inactive.  Accondingly  we  defin  C as  the  set  of  active 
commodities : 

*  {  (i»j).|  (i,j)  is  an  active  commodity} 

Furthermore,  we  assume  that  the  statistics  of  the  active  commodities 
are  stationary.  That  is,  they  do  not  change  from  one  time  to  another. 

After  we  have  developed  a  JFCR  algorithm  with  the  present  model,  we  shall 
discuss  its  application  to  a  quasi-static  case  in  chapter  IV.  There^both 
the  set  of  the  active  commodities  and  their  statistics  change  slowly  with 
time. 


ij 


Let  us  denote  by  r 


the  expected  traffic,  in  bits  per  second,  enter- 
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ing  the  network  at  node  i  and  destined  for  node  j,  We  shall  refer  to 
r  as  the  rate  of  commodity  (i,j).  The  statistical  nature  of  commodity 
(i,j)  can  not  be  completely  characterized  by  a  single  parameter  r _  and 
there  are  other  parameters  of  importance  such  as  the  variance  of  the  inter  - 
arrival  times  and  the  length  distribution  of  the  packets.  In  our  model, 
however,  we  do  not  use  any  other  statistical  parameter  of  the  commodities  ex¬ 
plicitly  and  characterize  commodity  (i.j)  completely  by  r^. ,  Nevertheless, 
the  statistical  characteristics  that  we  have  neglected  will  influence  the 
behavior  of  the  resulting  JFCR  strategy  implicitly  as  we  shall  see. 

For  the  purpose  of  accomplishing  flow  control  in  the  network,  we  assume 
that  it  is  somehow  possible  for  each  node  i  to  set  the  rate  of  any  active 
commodity  (i,j)  to  any  value  r„  which  is  selected  by  the  flow  control 
strategy  in  some  interval  0  <_  r^  <_  A  .  The  practical  mechanism  of  doing 

so  will  be  discussed  in  Chapter  IV.  Here  H..  denotes  the  maximum  of  r.. 

ij  1 1 

and  the  rate  at  which  commodity  (i,j)  would  have  entered  the  network  if 

there  was  no  flow  control  practiced  by  node  i.  We  refer  to  A.  as  the 

desired  rate  of  commodity  (i,j).  Since  we  have  considered  the  stationary 

case,  we  assume  that  A.,  is  a  fixed  value.  We  take  both  r . .  and  A.. 

ij  ij  ij 

to  be  zero  for  (i,j)tfCA> 

Let  f ^  denote  the  total  expected  flow  of  link  (i,k)  in  bits  per  second 
and  let  f^Cj)  denote  that  part  of  f  ^  which  is  destined  for  node  j.  Let 
s^  denote  the  total  expected  traffic,  in  bits  per  second,  at  node  i 


'Assuming  that  the  source  of  commodity  (i,j)  is  ergodic,  the  expected  traffic 
for  the  stationary  case  considered  here  can  be  written  as: 

*  l.i.m.  i  ,  (.no,  of  bits  of  commodity  (i.j)  entering  the  net- 
T-*°°  work  in  T  seconds) 

r^j  can  then  be  measured  approximately  over  a  limited  time  interval  T, 


'ij 
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destined  for  node  j.  Therefore  includes  both  r^  and  the  traffic 

from  other  nodes  that  is  sent  through  node  i  for  destination  j  . 

We  assume  that  for  every  link  (i,k),  there  is  a  buffer  space  reserved 
in  node  i  with  the  capacity  of  B^Cmax)  packets.  This  space  is  us.ed  to 
store  that  part  of  traffic  arriving  at  node  i  ,  which  should  be  sent  over 
link  (i,k).  If  the  data  arriving  at  link  (i,k)  for  a  limited  period  of 
time  exceeds  the  capacity  of  the  link  C^,  the  buffer  starts  to  fill  up. 
Similarly  when  the  arriving  flow  is  less  than  Cik  bits  per  second,  the 
buffer  starts  to  get  emptied.  In  the  long  run,  however,  since  Bik(max)  is 
a  limited  number,  if  there  is  no  buffer  overflow,  the  average  traffic 
arriving  at  link  (i,k)  is  equal  to  the  average  traffic  leaving  it.  Similar¬ 
ly  despite  the  short-term  fluctuations  in  the  amount  of  data  stored  in  the 
buffers,  if  there  is  no  buffer  overflow  the  expected  flow  into  a  node  i  for 
a  given  destination  j  ^  i  is  equal  to  the  expected  traffic  out  of  the  node 
for  that  destination,  i.e. 


Sij  “  rij  +  H  fmi(j) 


i.jeW,  i  /  j 


m: (m, i)eL 


"  ik  J 
k:  (i,k)el 


Finally,  let  t  ^  demonstrate  the  expected  delay  in  second  per  packet 
on  link  (i,k)  (including  queueing  delays  at  the  link  input)  and  let  Dik 
denote  the  expected  number  of  packets  waiting  at  node  i  for  transmission 
on  link  (i,k)  or  being  transmitted  on  link  (i,k). According  to  Little's 
formula: 


—  f  t 

r  *  ik  *  ik 


(i,k)ei 


where  T  denotes  the  expected  length  in  bits  of  a  packet  in  the  network.  We 


Fractically,  at  each  node  i,  the  available  buffer  can  be  shared  among  all 
the  outgoing  links  (i,k).  Therefore,  the  distinction  made  between  the  avail¬ 
able  buffers  of  outgoing  links  at  one  node  is  rather  artificial  and  is  just 
for  the  sake  of  theoretical  developments. 
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assume  that  D  is  a  function  of  f^  only.  As  an  axample  in  which  this 
assumption  is  not  a  good  approximation,  consider  a  network  with  two  commo¬ 
dities  which  have  different  packet  length  distributions,  In  this  case  D  ^ 
is  a  function  of  both  f^  and  the  routing  assignments  of  the  network  which 
determine  what  portion  of  each  commodity  will  pass  through  (i,k).  However, 
in  order  to  make  the  problem  analytically  tractable,  we  consider  D  as  a 
function  of  f  only. 

We  shall  consider  D^Cf^)  in  its  general  form,  only  making  the  reason¬ 
able  assumption  that  it  is  a  convex,  increasing  and  twice  differentiable 
function  on  the  interval  [O.C^’  Some  other  notations, which  will  be  used 
later, are  as  follows: 

s  The  set  of  all  node  flows  s„  ;  s  *  {s^  j  (i,  j  )eC} 

f  The  set  of  all  commodity  flows  f ^(j ) ;  f={fik(j )  j  (i,k)eL,  (i,  j  )eC} 

r  The  set  of  rates  of  all  active  commodities;  r  *  {r^ |  (i, j )tC^) 

A  The  set  of  desired  rates  of  all  active  commodities;  . | (i, j )eC  } 

lj  A 


2.2  Formulation  of  the  Problem  as  a  Convex  Optimization 

Before  we  can  present  our  formulation  of  the  problem,  we  need  to  dis¬ 
cuss  two  functional  quantities  which  are  the  core  of  our  strategy.  The  first 
quantity,  is  a  cost  function  assigned  to  each  one  of  the  links  of 

the  network.  As  long  as  the  average  number  of  packets  stored  at  link  (i,k), 
namely  Dik^flk)»  is  far  below  a  given  cri*  al  value  Bik,  g<k(fik)  is  equal 


to  When  Dik^ik^  gets  close  t0  Bik’  the  Cost  aPProaches  infinity 

(Fig.  2.1  )  •  is  a  fixed  parameter  chosen  according  to  the  size  of  the 

maximum  available  buffer  at  the  link,  B^Cmax)  ;  and  should  be  some  fraction 
of  it,  i, e.  0  <  Bik  /B^Cmax)  <  1.  Therefore,  the  cost  of  a  link  is  the 


-2 


r 


Fig.  2. 
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same  as  its  average  delay  as  long  as  the  link  is  far  from  becoming  satur¬ 
ated.  As  the  load  gets  heavier  and  the  average  quantity  of  stored  data 
approaches  the  limit  point  B^>  the  cost  builds  up  rapidly. 

Definition  2.1  To  each  one  of  the  links  of  the  network,  there  is  a  cost 
function  g  (D^)  assigned  with  the  following  properties: 


i) 

Pik  Dik  <<:  Bik 

ii) 

lim 

Dirtk 

8ik(Dik)  =  “ 

iii) 

8ik(Pik) 

is  a  convex  and  increasing  function  on  [0,Bik), 

iv) 

8ik(Dik) 

is  twice  differentiable  on  [O.B^)- 

We  define  Sik(Dik)  to  be  infinity  also  for  Dik  >  B^.  Properties  (iii)  and 
(iv)  are  added  for  the  sake  of  subsequent  mathematical  developments. 

Since  gik  is  a  function  of  Dik  ,  which  is  a  function  of  f^,  gik  is 
indirectly  a  function  only  of  f  With  some  abuse  of  notation  we  refer 
to  this  new  function  as  g  (f^)  •  The  following  lemma  is  an  immediate 
result  of  definition  2.1  and  the  assumptions  made  about  D^(f^j.)  in  Sec. 2.1 


Lemma  2.1:  For  each  link  (i,k)  there  is  a  number  Sik’  0  <  5ik  <  Cik  ’ 


for  which  lim 


fik^ik 


8ik^fik^  =  “  and  gik^fik^  is  convex>  increasing 


and  twice  differentiable  on  [0,5ik)  (fig-  2.1).  For  —  ^ik’  8ik^fik^ 


is  infinite. 


The  proof  is  easy  and  left  to  the  reader. 

We  refer  to  £  ^  as  the  effective  capacity  of  link(i,k)  and  to 

t  ,  /C,,  as  the  efficiencv  of  the  link.  From  now  on, we  describe  a 

ik  ik  ik 


-23- 


link  as  saturated  when  its  average  flow  has  reached  its  effective  capacity 
and  reserve  the  work  '’congested"  for  a  link  with  its  total  buffer  size 
B^(max)  filled  up  by  the  incoming  data.  Therefore," congestion" ref ers  to 
a  determinate  buffer  overflow  at  some  link  while  "saturation"  is  a  statisti¬ 
cal  measure  about  a  link. 

In  the  strategy  to  be  discussed  later,  the  effect  of  the  cost  function 

assigned  to  each  link  is  to  prevent  the  link  from  becoming  saturated.  In 

order  to  prevent  this  saturation,  the  active  commodities  will  have  their 

assigned  rates  reduced.  This  in  turn  requires  preventing  the  assigned  rate 

r  (i*j)sC  » from  becoming  too  small;  thus  we  should  introduce  some  cost 
lj  A 

on  the  amount  of  restriction  imposed  on  r  by  the  flow  control  strategy. 
This  explains  the  motive  for  the  following  definition: 


Definition  2.2:  To  every  active  commodity  of  the  network,  (i,i)eC  we 

A 

assign  a  cost  function  with  either  of  the  following  properties: 


a  -  *s  3  positive,  decreasing,  twice  differentiable  and 

strictly  convex  function  on  [O,00)  (Fig. 2.2. a) . 


b  -  e,,(r  ,)  is  a  oositive, 

ij  ij 

strictly  convex  function  on  (0,°°). 
(Fig.  2. 2.b ) . 


decreasing,  twice  differentiable  and 


Furthermore  lim 

r,  .-*-0 
ij 


W 


We  will  refer  to  these  two  types  of  commodity  cost  functions  as  the 
cost  function  without  or  with  singularity  at  point  zero.  Throughout  our 
discussion  in  this  report  we  usually  consider  the  commodity  cost  functions 
without  singularity  at  point  zero.  Wherever  we  consider  cost  functions  with 
signularity  at  point  zero  we  shall  specify  that. 


At  this  point  we  can  define  the  total  transmission  cost  and  the  total 
flow  control  cost  of  the  network,  respectively,  as  follows: 


E  8ik<fik> 

(i,k)cl  lk 


Et  *  1-  «n<rn> 

(i,J)eCA  3  3 


Our  joint  flow  control  and  routing  formulation  follows  immediately: 


min  J  =  Et  +  Gt 
f  ,r 

(2.1) 

fik(j)  i  o 

i  i4  j,  (i,k)el 

(2.1. a) 

ri^° 

(i,j)eCA 

(2 . 1 . b) 

rii  £ 

N 

U,j)eCA 

(2.1.c) 

fik(j)  -  ’ik 

i+i 

(i,k)el. 

(2 . 1 .  d) 

l  fik(^  -  r  fu(3)  =  rij  (i'j)eC 

k: (i,k)sL  l:(Z,i)zL 


(2.1.e) 
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To  verify  that  the  solution  to  this  problem  presents  a  set  of  desired 
inputs  r  and  link  flows  f  for  the  purpose  of  flow  control  and  routing  in 
the  network,  we  proceed  in  the  following  steps: 

i)  J  is  a  convex  function  of  the  variables  (r,f)  on  the  set  of  feas¬ 
ible  points  defined  by  constraints  (2.1. a)  -  2.1.e)  (which  is  a  convex  set). 


ii)  The  objective  function  J  becomes  infinite  if  f.,  *  ,  i.e. 

ik  ik’ 

for  some  link  (i,k).  J  has  a  finite  value  if  the  rates  of  all 

of  the  active  commodities  are  sufficiently  small  so  that  all  of  the  link 

flows  stay  below  the  corresponding  effective  capacities. 

iii)  (i)  and  (ii)  imply  that  (2.1)  has  at  least  one  optimal  point 
*  * 

(r  ,f  )  and  at  any  ptimal  point  the  objective  function  J  is  limited  and 
the  constraint  (2.1.d)  is  inactive. 


iv)  The  value  of  r  in  any  optimal  solution  to  (2.1)  is  unique.  We 
show  this  by  contrapositive  proof.  Suppose  that  there  are  two  optimal  points 
(r^-.fl)  and  (r2,f2),  with  the  corresponding  objective  function  J  .  Since 

is  a  strictly  convex  function  of  r  and  Gx  is  a  convex  function  of  f,  for 
any  0  <  X  <  1  we  have: 

JUr1  +  (1  -  A)r2,  Af1  +  (1  -  A)f2]  -  ^[Ar1  +  (1  -  A)r2]  + 

CT[Xf1  +  (1  -  X)f2]  <  Atf^r1)  +  GT(f1)]  +  (1  -A)[ET(r2)  +  Gx(f2)] 

*A*J(r1,f1)  +  (1  -X)-J(r2,f2)  =  J* 

11  2  2 

This  contradicts  the  assumption  that  (r  ,f  )  and  (r  ,f  )  are  optimal  points. 
Therefore  r  at  any  optimal  point  (r  ,f  )  is  unique. 

v)  Furthermore,  (ii)  implies  that  at  the  optimal  point  none  of  the 
links  is  saturated,  i.e.  D  <  B^  for  all  (i,k)eL,  This  means  that  the 
average  number  of  packets  waiting  on  each  link  (i,k)  can  be  kept  below  any 
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desired  number  B,,  .  Nevertheless,  due  to  the  statistical  variations  in  the 
ik 

buffer,  there  will  still  be  some  chance  of  buffer  overflow  (congestion)  at 
the  link.  By  making  the  ratio  small  enough*  one  can  reduce  the 

probability  of  buffer  overflow  arbitrarily.  But  there  are  costs  incurred 
in  reducing  ,  since  this  means  either  an  increase  in  B  (max) 

which  is  costly  or  a  decrease  in  B^  which  reduces  the  effective  capacity 
of  the  link. 

In  summary,  the  JFCR  strategy  effectively  controls  the  average  load  of 
the  buffers,  which  is  to  some  extent  helpful  in  preventing  congestion  in 
the  network.  In  order  to  prevent  congestion  more  effectively  ,  we  need  to 
control  the  statistical  fluctuations  of  the  buffer  loads  as  well.  Therefore 
other  means  of  control  should  be  implemented  together  with  the  present  scheme. 
We  will  investigate  this  issue  in  more  details  in  chapter  IV. 

vi)  At  an  optimal  point  (r  ,f  ),  f  defines  a  set  of  minimum  cost 
routing  flows  for  the  set  of  inputs  r  ,  with  the  cost  assignements  g 
for  the  links.  This  cost  is  almost  equal  to  the  delay  of  the  link,  Dik(fik), 
as  long  as  f  ^  is  far  below  the  effective  capacity  as  f^  approaches  the 

effective  capacity,  -*■  00  (Fig.  2.1  ).  This  means  that  the  data  will 
first  be  routed  with  the  objective  of  minimizing  the  total  delay.  But  as 
soon  as  some  of  the  buffers  get  close  to  the  saturation  level,  the  routing 
will  be  adapted  with  the  objective  of  sending  data  over  the  nonsaturated 
links.  Despite  this  apparent  difference  between  minimum  delay  routing  and 
the  routing  in  our  strategy,  there  exists  a  basic  similarity  between  them. 

The  following  example  presents  an  interesting  case  where  this  similarity  is 
most  evident. 

Example  2.1  Assume  a  network  with  M/M/1  queues  at  all  of  the  links  and  let 
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complete  our  argument,  all  we  need  is  to  justify  the  appropriateness  of  the 

* 

set  of  assigned  inputs  r  .  The  rest  of  this  chapter  is  oevoted  to  this 
purpose. 


2.3  Necessary  and  Sufficient  Conditions  for  Optimality 

Before  obtaining  the  optimality  conditions  we  need  to  state  the* 
following  definitions: 

Definition  2.3  Any  sequence  of  links  connecting  an  arbitrary  pair  of  nodes 
i  and  j  is  a  route  R(i,j).  That  is 

R(i»j)  *{(  nk_j_*  nk)  >  k  *  s  t,  n^  »  i,  »  j  and(n^  ^ ,  n, ) e 


Definition  2.4  A  route  R(i,j)  is  called  an  active  route  if  there  is  some 
nonzero  traffic,  travelling  from  node  i  to  node  j  over  this  route. 


Definition  2.5  At  a  given  feasible  point  (r,f),  the  length  of  any  route  R 
is  the  sum  of  the  marginal  costs  of  all  of  the  links  contained  in  R  That  is 

l  d8r 


length  of  R 


T  Vr  "k 

i  i  d  f 

k_1  Vi>\ 


Definition  2.6  At  a  given  feasible  point  (r,f),  the  distance  of  a  node  i 
from  another  node  j,  X  ,  i-s  the  minimum  length  over  all  possibel  routes 
connecting  i  to  j . 


Notice  that  X^  is  not  necessarily  equal  to  X^,  We  take  X^  *  0  for 


jeN. 


Definition  2.7  The  priority  function  of  any  active  commodity  p^  (r^), 
(i,j)eCA,  is  the  negative  of  its  marginal  cost  function,  i.e. 
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W 


den<cii> 


d  r 


ij 


Ci,  j  )eC, 


It  follows  from  definition  2.2  that  p^(r^^)  is  a  positive,  strictly  de¬ 
creasing  and  differentiable  function  on  either  (0,®)  or  [0,®)  depending  on 
whether  or  not  e„(r^)  ^as  a  singularity  at  point  zero. 


*  * 


Lemma  2.2  Given  an  optimal  point  (r  ,f  ),  the  length  of  any  active  route 


connecting  an  arbitrary  node  i  to  another  node  j,  is  X„  .  Furthermore 
for  (i,j)eCA 


xu 


*  p . . (r .  . ) 

ij  ij 

A.  . 
13 

>  r*.  >0 

13 

p . .  (r*. ) 

>  3  ij 

* 

r . . 
13 

-  0 

<  p .  .  (r  *  ) 

-  13  13 

* 
r .  . 
13 

=  A.  . 

13 

(2.2) 

This  lemma  is  proved  in  Appendix  A.  The  following  corollary  is  a  direct  re¬ 
sult  of  definition  2.6  and  lemma  2.2: 


*  * 


Corollary  2.1  At  any  optimal  point  (r  ,f  ),  for  any  link.  (i,k)el  and  any 
node  jeW: 


where  gjk(fik> 


'  (f  *  )  +  X.  ,  -  X.. 
ik  ik  kj  ij 

* 

f  ik 
* 

a)  >  o 

f  ik 

(j)  -  0 

(2.3) 


d  f-i, 

lk 


Theorem  2.1:  The  necessary  and  sufficient  conditions  for  a  feasible  point 


*  * 


(r  ,f  )  to  be  a  minimizing  point  for  (2.1)  is  that  there  exists  a  set  of 
positive  number  >  i,j  eN  ,  (£  =  0,  jeW)  such  that: 


8ik(fik)  +  *kj  "  3ij 

^ij 


fik  >  ° 


f ik  (J)  *  0  (i,k)eL,  jeM 


(2.4) 
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p  (r  )  «  8 

pij  vriJ  '  '  ij 


0  <  ru  < *« 


>  S 
-  Pij 


‘ij 


^  ’ij 


"ij 


ij 

0  (i, j)eC, 


(2.5) 


Proof :  The  necessity  follows  directly  from  corollary  2?1  taking  8  *  , 


i,jeN  .  The  sufficiency  is  proved  in  appendix  A. 


Now  consider  two  nodes  i  and  j  for  which  s„  >  0.  By  writing 


Eq.  (2.4)for  all  of  the  links  of  some  active  route  R(i,j)  and  summing  them 


up,  one  can  see  that  3..  is  equal  to  X...  Similarly  if  s . .  “  0  for  some 

ij  ij  ij 


nodes  i  and  j>  we  can  consider  Eq.  (2.4)  for  each  of  the  links  of  a  minimum 


length  route  R(i,j)  and  see  that  8  <_  X  .  These  results  are  stated  in 


the  following  corollary. 


Corollary  2.2  For  any  set  of  positive  numbers  3^,  i,j  (8„  =  0,  jeW) 

that  satisfies  (2. 3^we  have: 


Sij  =  Xij 


s  .  >  0 


* 
s .  . 
ij  = 


0  (2.6) 

Finally  we  should  point  out  that  the  above  results  are  still  valid  if  any 

cost  function  eij(rij)  has  singularity  at  point  zero.  In  this  case,  however, 

we  know  that  r*  >  0  and  the  optimality  conditions  with  respect  to  r 
ij  13 


reduce  to  a  simpler  form. 


2.4  Utilization  of  Network  Resources 

Having  the  necessary  and  sufficient  conditions  for  optimality  at  hand, 

* 

let  us  consider  the  set  of  optimal  inputs  r  and  see  how  they  correspond 
with  our  expectations  of  a  flow  control  scheme,  A  suitable  flow  control 
scheme  should  comply  with  the  following: 
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i)  It  should  be  fair  with  respect  to  different  users.  The  scheme 
should  not  relieve  congestion  by  imposing  restrictions  only  on  some  of  the 
users  -  arbitrarily  chosen  -  and  leaving  the  rest  free  .  It  rather  should 
impose  restriction  on  the  users  either  evenly  or  preferably  according  to 
some  pre-established  set  of  priorities. 

ii)  The  restrictions  imposed  on  the  users  should  not  go  beyond  the 
necessary  magnitude.  In  other  words,  the  scheme  should  tend  to  confine  input 
flows  only  when  it  becomes  unavoidable  in  order  to  keep  the  network  un¬ 
saturated. 

In  the  present  section  we  investigate  the  validity  of  the  second 
property  in  our  scheme  and  leave  the  discussion  of  the  first  property  for 
section  2.5.  Consider  the  following  optimization  problem; 


min  J  -  S  6ij 

f-r  (i,j)eCA 

<t«) 

(2.7) 

fikU)  1  o 

i  +  j ,  (i,k)sL 

(2. 7.  a) 

rii^° 

<i.j)eCA 

(2 . 7 ,b) 

rij  i  *ij 

(i,j)eCA 

(2.7.c) 

(i,k)el 

(2.7 ,d) 

£  fik(j)  - 

k:(i,k)eL  1K 

H  fu(j)  =  r  . 

i  *  j 

(2.7 

This  problem  is  identical  to  (2.1)  execept  that  the  link  cost  functions  are 
eliminated  from  the  objective  function.  However,  constraint  (2,l.d)  is  kept 
here  to  guarantee  that  at  any  optimal  point  no  buffer  may  become  oversaturated. 


Since  «  (r  ) , (i, j)eC  ,  are  decreasing  functions.it  is  clear  that  at  any  optimal 
ij  ij  A 
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point, none  of  the  input  rates  can  be  increased  without  violating  (2.7.C.) 
or  (2.7.d).  Therefore  the  optimization  problem  (2.7)  does  not  impose  restric¬ 
tions  on  the  users  beyond  what  is  necessary  to  keep  the  network  unsaturated. 

Due  to  the  difficulties  involved  in  finding  the  optimal  point,  the 
flow  control  scheme  formulated  by  (2 . 7) , currently  does  not  appear  to  be 
suitable  for  implementation.  Nevertheless,  as  the  following  theorem  indi¬ 
cates,  it  can  be  approximated  by  the  proposed  JFCR  strategy  if  a  set  of 
appropriate  cost  functions  are  used. 

Theorem  2.2  Let  «ik(fik).  (i,k)cL,  and  Cr±j ) »  (i,j )cCA, satisfy  the 

conditions  of  definition  (2.1)  and  (2.2).  Let  {e  }°°  ,  be  a  decreasing 

m  m*i 

sequence  of  positive  numbers  with  the  limit  point  zero*  Assume  that  (rm,fm) 
is  a  solution  to  problem  (2.1)  with  the  cost  function  8ik(^ik)  replaced  by 

8ik^fik^  *  em  *  8ik^f ik^ ’  Then  any  point  of  the  sequence 

{ rm , f m  is  a  solution  to  (2.7). 

This  theorem  is  a  specific  case  of  the  barrier  function  theorem  which 
is  proved  in  [15],  It  shows  that  by  sufficiently  decreasing  the  magnitude  of 
the  link  cost  functions,  one  can  bring  the  solution  of  (2.1)  arbitrarily 
close  the  the  boundaries  where  no  more  increase  is  possible  on  the  rate  of 
any  commodity.  Notice  that  if  one  holds  r  constant  and  minimizes 

J*  -  ET(r)  +  S  e  ,  g  ,  (f  ,  )  over  f  only,  then  the  minimizing  f 

u,k)eL 

is  identical  for  all  Em  >  0.  In  other  words,  the  routing  objective  does 

not  change  when  the  cost  functions  of  the  links  are  all  multiplied  by  >  0. 

Despite  what  it  may  seem  from  the  above  discussion,  a  very  small  (or 
zero)  value  of  is  not  desirable,  since  one  can  argue  that  in  practice 
there  is  a  cost  to  using  each  link  (i,k)  that  raises  rapidly  as  f  ^  approaches 
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and  that  this  cost  should  really  appear  as  a  trade-off  against  in¬ 
creasing  input  rates.  This  would  in  effect  lead  to  the  optimization  problem 
(1.1).  Furthermore,  solving  problem  (2.1)  requires  much  computation  if  £ 

m 

is  too  small. 


2.5  The  Trade-off  Between  Priority  Functions  of  Different  Users 

In  this  section,  we  study  the  effect  of  the  priority  functions 

p  (r  ),  (i,j)eC  ,  on  the  assigned  set  of  input  rates  r  and  investigate 
ij  ij  " 

the  fairness  of  this  set  with  respect  to  different  users.  In  particular,  we 
show  that  in  offering  the  service  to  the  users,  a  variety  of  types  of  prior¬ 
ities  between  them  can  be  achieved  through  the  appropriate  choice  of  priori¬ 
ty  functions  for  each  user  .  In  doing  this,  we  restrict  ourselves  to  the 
following  class  of  priority  functions  with  singularity  at  point  zero: 


W 


lj 


>  1 


(2.8) 


We  refer  to  and  n„  respectively  as  the  priority  factor  and  priority 

order  of  the  commodity  (i,j).  Naturally,  choosing  the  priority  functions 

from  a  more  general  class  may  prove  to  provide  additional  features  compared 

to  what  we  can  obtain  from  this  class. 

In  our  evaluation  of  the  fairness  and  priority  issue,  we  temporarily 

eliminate  constraint  (2.1.c)  from  problem  (2.1)  by  letting  K  =  *  »  (i,j)eC 

ij  A 

* 

therefore  making  sure  that  in  the  set  of  optimal  input  rates  r  all  the 
restrictions  are  imposed  by  the  flow  control  scheme  and  not  by  the  users 
internal  limitations.  Therefore,  with  these  assumptions  we  always  have 
0  <  r^j  <  ,  (i,j)eCA,  Accordingly  (2.5)  reduces  to 

pij(rij}  "  Aij  Ci,j)eCA 


(2.9) 
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In  the  following  discussion,  we  explain  in  several  steps  the  types  of 
priorities  which  can  be  achieved  using  the  class  of  priority  functions  (2.8): 


i)  First  consider  two  commodities  a  and  b  using  priority  functions 

of  the  class  (2,8)  with  the  same  priority  order  na  =  ■  n  and  assume  that 

the  distance  of  source-destination  nodes  is  equal  for  them,  i.e.  X  *  A 

*  a  b 

r  a 

Under  these  conditions,  from  (2.8)  and  (2.9)  we  have  — qj  =  —  .  Thus, when 

rb  ab 

several  commodities  of  the  same  priority  group  (i.e.  with  equal  priority 
orders)  experience  similar  network  conditions  (i.e.  travel  through  equal 
source-destination  distances),  the  assigned  throughput  of  each  one  is  pro¬ 
portional  to  its  priority  factor.  Therefore,  larger  priority  factors  should 
be  assigned  to  the  bigger  users. 


ii)  Now  consider  two  commodities  a  and  b  with  the  same  priority 

order  n  and  priority  factor  a.  In  order  to  explore  the  effect  of  the 

topological  distance  of  the  source  and  destination  of  a  commodity  on  its 

assigned  throughput,  we  assume  that  all  of  the  links  have  equal  marginal 

cost  at  the  optimal  point.  In  this  case  if  the  number  of  links  in  an  active 

route  of  commodity  a  is  m  times  the  number  for  b,  we  would  have 

A  *  m  .  A,  .  Therefore, 
a  o 


Pa(ra  } 


pb(rb} 


m 


* 

r 

*4- 


_-l/n 


m 


For  n  *  1,  the  throughputs  are  inversely  proportional  to  the  source-desti¬ 
nation  topological  distances.  As  n  increases,  the  throughputs  become  less 

r* 

g 

sensitive  to  distance.  As  an  example,  for  n  =  4  and  m  =  2,  —  =*  0.84. 

rb 

We  conclude  that  n  3  1  in  some  sense  gives  each  user  equal  resource,  where 
n  -*■  ®  gives  each  the  same  throughput, 

iii)  Finally  consider  two  commodities  a  and  b  with  priority  orders 
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n  and  n,  and  priority  factors  a  and  a.  .  If  the  set  of  active  commodi¬ 


ties  changes,  for  example  if  some  new  commodities  become  active,  the 

* 
rb 


*  * 

optimal  input  rates  r  and  r  may  also  change.  We  would  like  to  compare 


a 

*  * 

the  amount  of  changes  that  r  and  r,  undergo  when  some  change  of  traffic 

a  b 

happens  in  the  network  and  investigate  the  impact  that  na  and  n^  might  have. 
Since  this  comparison  in  general  is  complicated,  we  consider  the  two  commo¬ 
dities  under  exactly  similar  network  conditions,  that  is  we  let  both  of  them 
have  the  same  source  and  destination  nodes  i  and  j A  In  this  case  it 
follows  from  (2.8)  and  (2.9)  that: 

.  -1/n 


r  =  a  .  A .  . 
a  a  ij 


and  r. 


-1/nb 

'ij 


Since  the  change  in  the  traffic  will  be  reflected  in  r&  and  r^  through  *. 


dr 


let  us  compute  — 


ij 


,  * 
dr 

a 

dXu 

»  a 

a 

-1 

. 

n 

a 

or 

,  * 
dr 
_ a 

-1 

d\  . . 

.  ij 

r  * 
a 

”  n 

a 

xu 

Similarly 

,  * 
drb 

-1 

.jhi 

nb 

x« 

-  —  -  1 
na 

•xu 


(2.10) 

(2.11) 


Therefore,  from  (2.10)  and  (2.11) 


dr’ 


% 


dr’ 


(2.12) 


In  our  model  of  the  network,  we  considered  the  traffic  between  any  source' 
destination  pair  as  being  one  commodity  just  for  the  sake  of  simplicity 
in  the  use  of  notations.  The  results  obtained  here  with  this  assumption 
all  will  stay  valid  if  we  consider  several  commodities  between  any  source 
destination  pair. 


Eq.  (2.12)  means  Chat  when  the  traffic  in  the  network  changes,  then  the  ratio 
of  the  percentage  of  change  in  the  rate  of  one  commodity  to  that  of  the  other 
is  inversely  proportional  to  their  priority  orders,  given  that  the  two  commo¬ 
dities  experience  similar  network  conditions  (have  the  same  source  and  desti¬ 
nation).  This  does  not  mean  that  if  we  increase  the  priority  orders  of  some 
commodities,  the  assigned  input  rates  of  all  of  them  will  necessarily  become 
less  sensitive  to  the  changes  in  the  network  traffic.  This  is  because  the  com¬ 
parison  was  made  between  two  commodities  which  exist  in  the  network  at  the  same 
time  and  not  between  two  which  replace  each  other. 


We  conclude  from  the  above  comparison  that  in  general  if  there  is  a 
combination  of  commodities  with  high  and  low  priority  orders  in  the  network, 
as  the  number  of  active  users  goes  up,  the  high  priority  order  users  will  be 
pushed  back  more  slowly  at  the  cost  of  lower  priority  users  being  slowed  down 
more  rapidly.  This  is  exactly  our  expectation  of  a  priority  service  system. 

A  quantitative  analysis  of  the  sensitivity  of  the  assigned  input  rates  with 

to 

respect  to  the  changes  in  the  set  of  active  users  or  changes  in  the  set  of 
desired  input  rates  -t,  requires  further  study. 

We  can  only  add  here  that  the  sensitivity  of  the  assigned  input  rates 


r  ,  with  respect  to  the  changes  in  the  desired  input  rates  of  those  commodi¬ 


ties  for  which  r„  <  ■'t..,  is  zero.  Tu^s  implies  that  if  a  user  of  the  network 
i  j  ij 


is  not  assigned  as  much  throughput  as  it  desires  (namely  r„  <  A.  for  some 

* 

(i,j)/,it  can  not  provoke  any  increase  in  the  assigned  throughput  r„  by 


exaggerating  about  its  desired  rate1,  namely  by  increasing  .  The  desired 


input  rate,  reported  by  each  user,  only  upper  bounds  the  assigned  throughput 
and  has  no  other  impact.  This  is  a  basic  and  important  characteristic  of  the 
proposed  JFCR  strategy  which  is  common  to  any  type  of  priority  function  used. 
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CHAPTER  III 

SOLUTION  OF  THE  JFCR  CONVEX  OPTIMIZATION  PROBLEM 

Our  primary  goal  in  this  chapter  is  to  show  how  the  convex  optimization 
problem  (2.1)  can  be  solved  in  an  iterative  way  using  distributed  computa¬ 
tions  in  the  network.  In  the  first  section,  however,  we  present  a  rather 
general  approach  to  the  solution  of  (2.1),  by  making  a  simple  analogy  between 
problem  (2.1)  and  a  minimum  delay  routing  problem  in  general.  This  analogy 
actually  reduces  the  problem  to  a  minimum  delay  routing  problem  and  show’s  how 
any  method  of  obtaining  a  minimum  delay  routing  can  be  generalized  to  a  so¬ 
lution  of  problem  (2.1). 

In  the  following  sections  first  we  reformulate  the  JFCR  problem  (2.1) 
in  terms  of  some  new  routing  variables (different  from  f)  which  then  allow  us 
to  design  some  algorithms  using  distributed  computations  at  the  nodes  of 
the  network  to  find  the  set  of  optimal  inputs  and  optimal  routing  for  the 
network, 

3 . 1  Analogy  of  the  JFCR  Problem  with  the  Minimum  Delay  Routing  Problem 

Consider  a  data  communication  network  M  as  modelled  in  section  2,1  and 

let  us  construct  a  new  network  M  by  making  the  following  changes  in  M: 

Keep  the  nodes  of  M  unchanged  but  add  one  new  link  between  any  pair  of 

nodes  (i,j)  for  which  an  active  commodity  exists  in  M.  We  denote  this  newly 
» 

added  link  by  (i,j  )  in  order  to  distinguish  it  from  an  old  link  (i,j)  which 
might  exist  in  M  (and  also  £T)  .  Thus  notice  that  j'  does  not  indicate  a  node 
different  from  j  but  the  link  (i,j’ )  is  different  from  the  link  (i,j). 


I 


Therefore  if  TI  t  T  and  <T  respectively  denote  the  set  of  nodes,  the  set  of 
links  and  the  set  of  commodities  of  the  new  network  AT  we  have 

V  --  N,  r*  L\J  C,  ,  Z  *  C 

A 

Let  the  capacities  and  the  average  delays  of  the  links  of  £T  be  as  follows: 


C , .  * 
ik  ik 


Dik(fik)  =  Sik(fik) 


(i,k)el 


(3.1. a) 


C  '  »  K. . 
ij  ij 


Assume  that  the  cost  functions  e  (r  )  ,  (i,j)£C,  ,  have  a  singularity  at 

ij  ij_  A 

point  zero.  It  follows,  then  that  E..»  (f..'  ),  (i,j)£C  ,is  a  positive,  in- 

i  J  ij  A 

creasing,  strictly  convex  and  twice  differentiable  function  on  [0,^)  and 

lim  D„  ,  (f ^ ,  )  =  00  (Fig.  3.1).  Therefore,  complies  with 

X. . 
ij  ij 

all  of  the  properties  assumed  for  the  total  delay  of  a  link. 

Finally,  assume  that  no  flow  control  is  practiced  in  M  and  the  through¬ 
put  of  commodities  of  JT  is  r..  =4..,  (i,i)eC  . 

ij  H 

In  summary,  to  construct  network  JT  we  have  assigned  the  desired  input 

rates  K..  to  each  commodity  of  M  and  instead  have  added  a  new  link  with  capa- 
ij 

city  /i  between  i  and  j.  Now  consider  the  following  minimum  delay  routing 
problem  for  network  : 


Fig.  3.1 


D...  (f ...  ) 

11  N 


eij<V 
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min  Dt  Cf) 


£  °lk  «lk> 

(i,k  )eL 


^  Dij '  (fij ' } 
(i, j )eC 


fik(j)  0  i  i  j  ,(i,k )zL,  JeW 


_>  0  i  +  m,  (i,j )eCas  meM 

£  ?ik(j)  '  .  3  .  (Ui)tC 


k:(i,  k)eL 


2.:(x.,i)eL 


U' 


ij 


(3,2) 

(3. 2. a) 
(3.2.b) 
(3.2.c) 


Notice  that  the  upper  limits  on  link  flows  are  eliminated  since  given  (3.1) 
they  are  aU  inactive  at  any  point  with  a  finite  objective  value. 

Lemma  3 . 1  :  There  is  at  least  one  optimal  point  for  (3.2)  for  which  each 

supplementary  link  (i,jr)  carries  traffic  only  for  destination  j,  i  e. 


f  ij  '  ^  *  0 


(i,j)eCA  ,  meW,  m  i  j 


Proof :  Let  f  be  any  optimal  point  for  (3.2).  Consider  any  link  (i.j'), 

(i, j )eC  ,  and  let  f . . , (m)  >  0  for  some  m  i  j ,  We  have  f .  . ,  ( j )  <  K  -f . . , (m) . 
A  ij  ij 

Therefore,  some  part  of  the  commodity  (i,j),  namely  some  part  of  r„  =  -t 
is  routed  to  the  destination  j  over  some  route  other  than  link  (i,j').  Call 
this  part  f±x  (j).  Obviously  fix  (j)  *  X  -  f^.Cj)5,  f^.Cm)  • 

If  we  let  the  flow  f..,(m)  and  an  equal  part  of  the  flow  f  ( j )  interchange 

ij  ix 

their  routes  to  the  node  j ,  the  aggregate  flows  of  the  network  M}  and  the 

total  delay  do  not  change.  Therefore. the  new  routing  is  also  optimal. 

Through  repeating  this  interchange  of  routes  for  all  flows  such  as  f ^ , (m) 

we  come  up  with  an  optimal  point  satisfying  f . . , (m)  =  0,(i,j)eC  ,  m  ^  j . 

ij  A 


Q.E.D. 


& 
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Corollary  3.1  Any  solution  to  the  following  routing  problem  is  a  solution 
to  (.3.2): 


min  Dt (f ) 


£  °ik<V  +  EV 

(i,k)£i.  (i.j)eCA 


(3.3) 


fik  (j)  >  0  (i,k)eL,  jeW,  j  +  i  (3. 3. a) 

f'i j .  0)  I  0  (i ,j)£CA  (3.3.b) 

£  *ikCj)  “  ^  ^(j)  “  'rij  (i.j)eC  (3 . 3 . c) 

k:  (i,k)eL  &:(£,  i)eL 

f ^ .  (m)  -  0  (i,j)sCA,  meW,  m  #  j  •  (3 . 3 . d) 


Theorem  3.1:  Let  the  cost  functions  corresponding  to  the  commodities  of  net¬ 
work  M  have  singularity  at  zero.  The  JFCR  problem  (2.1)  for  network  M  then  is 
equivalent  to  the  routing  problem  (3.3)  for  network  U  ,  Furthermore,  there 
are  solution  points  to  (3.2)  which  are  also  optimal  for  (2.1).  The  equiva¬ 
lent  variables  are  as  follows: 


fik(J> 


ij 


fijt(j) 


'ij 


(i,k)eL  ,  jcW  ,  j  i 

U.j)eCA 


Proof:  Easy  to  verify. 


The  above  theorem  is  important  in  showing  how  to  solve  problem  (2.1) 
by  relating  it  to  the  routing  problem  which  is  intensively  studied.  It 
shows  that  the  nature  of  both  problems  and  their  degrees  of  mathematical 
complexity  are  the  same,  and  the  JFCR  problem  only  involves  a  somewhat  larger 
number  of  variables  compared  to  a  routing  problem  for  the  same  network. 
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Accordingly,  any  static  or  quasi-static  approach,  using  central  or  distribu¬ 
ted  computations  to  the  minimum  delay  routing  problem  which  proves  to  be 

successful,  can  be  used  for  solving  the  JFCR  problem.  There  are  two  prob¬ 
lems,  however,  in  the  blind  application  of  a  routing  algorithm  to  solve  the 
JFCR  problem.  The  first  is  that  each  dummy  link  (i,j')  should  be  used  only 
for  the  (rejected)  traffic  destined, for  j.  The  second  and  most  important 
is  that* both  in  terms  of  implementation  and  convergence,  the  dummy  links  should 
be  treated  differently  than  the  other  links.  The  next  three  sections  deal  with 
these  problems. 

3.2  New  Formulation  of  JFRC  Problem  Aimed  at  Distributed  Solution 

Gallager  in  a  recent  paper  14]  shows  how  a  minimum  delay  routing  problem 
‘in  the  quasi-static  case  can  be  solved  using  only  distributed  computations 
at  the  nodes  of  the  network.  The  core  of  his  approach  is  a  new  set  of  para¬ 
meters  ^(j),  called  routing  variables,  instead  of  the  conventional  vari¬ 
ables  in  order  to  formulate  the  routing  problem.  Here,  in  order  to 

develop  a  distributed  JFCR  alogrithm,  we  shall  use  the  same  variables.  In 
the  present  section,  we  introduce  these  net-  variables  and  restate  JFCR 
problem  (2.1)  and  the  corresponding  optimality  conditions  in  terms  of  them. 
Then  in  sections  (3.3)  and  (3.4)  we  work  out  some  distributed  JFCR  algorithms. 
The  approaches  taken  in  these  two  sections  are  different,  however.  In 
section  3.4,  we  use  the  analogy  made  between  routing  and  JFCR  problems  and, 
as  described  earlier,  simply  use  a  class  of  distributed  routing  algorithms 
for  network  M  to  come  up  with  a  corresponding  class  of  JFCR  algorithms.  In 
section  3.3,  however,  we  take  a  rather  direct  approache  and,  while  still 
using  many  of  the  results  in  Gallager  [4],  try  to  keep  the  distinction 
between  routing  and  flow  control  parameters. 
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Now  let  us  consider  the  network  as  modelled  in  sec.  2.1.  Let 
(i,k)el,  j  +  i,  denote  the  fraction  of  the  node  flow  s^  which  is  sent  over 
the  link  (i,k).  It  follows  that 


f ik^j )  •  s.j  .  tt>ik(j)  (i,k)cL  ,  jeW  ,  i  j*  j  (3.4) 

sij  ”  rij  +  ^  skj  4ki(J>  i>j£N  ’  1  *  J  (3-5) 

k: (k,i)cL 

More  formally  let  us  define  a  routing  variable  set  0  for  network  M  as  a 
set  of  nonnegative  numbers  ^ik(j)>  *-*3’^  i  ^  j  »  satisfying: 


a)  «ik(j) 


(i,k )tL  ,  jeN 


b) 


4ik<j> 


c)  for  each  (i,j)eC  ,  there  is  at  least  one  sequence  of  nodes 

A 


i,k  ra,j  such  that  4>ik(j)  >  0,  ( j )  >  0, , , ,  ,4^  (j)  >  0. 


k£ 


mj 


Thpnrpni  3.2:  For  any  routing  variable  set  $  and  any  set  of  input  rates  r,  there 

is  a  unique  set  of  node  flows  s  and  link  flows  f  as  the  solution  to  (3.4) 

and  (3.5).  Each  component  s..  or  f..(j)  is  nonegative  and  continuously 

ij  ik 

differentiable  as  a  function  of  r  and  6. 

For  proof  see  Gallager  [4].  The  above  theorem  shows  that  any  quantity 
which  can  be  expressed  in  terms  of  (r,f)  can  also  be  expressed  in  terms  of 
( r ,<J> ) .  We  can,  therefore,  restate  problem  (2.1)  as  the  following: 


min  J  =  ET(r)  +  GT(r,0)  (3.6) 

r,i 

>  0  (i,j)£CA  (3. 6. a) 

r  <.t  U,j)eCA 


(3.6.b) 
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$  is  a  routing  variable  set 


(3.6.c) 


Constraints  2.1. a.  and  2.1, e  are  inherent  in  the  definition  of  a  routing 
variable  set,  as  theorem  3.2  establishes;  and  constraint  2.1.d  is  inactive 
at  any  point  with  limited  objective  value-  Therefore  they  are  not  repeated 
in  problem  (3.6). 

Theorem  3.3:  the  following  equations  are  valid  and  lead  to  a  unique  set  of 

solutions  for  and  _ , rr  ,  which  are  both  continuous  in  r  and 

ij  vik^; 

i  for  (i,k)el,  jeW,  j  ?i  i 


3G 

3r . .  '  L 

k: (i,k)el 

tg’  Of., 

ik  ik 

3g 

taking  -r— —  *  0 

3rjj 

jeN 

3gt 

3*lk(J)  "  Sij  [g  ik(fik} 

9G_ 

,  T 

?r 

kJ 

(3.7) 


(3.8) 


Proof:  Similar  results  are  proved  by  Gallager  [4]  for  the  function 

°T  "  23  Dik(fik)  istead  of  gt  *  23  8ik(fik)-  Since  g±k(f ±k.)  shares 

U,k)tL  (i,k)si. 

all  of  the  properties  assumed  for  Dik(fik).  theorem  3.3  is  also  valid.  Q.E-D. 

At  this  point  we  can  state  the  optimality  conditions  of  the  JFCR  problem 
with  the  new  formulation. 


Theorem  3.4:  The  following  conditions  are  sufficient  for  any  feasible 
*  * 

point  (r  ,i  )  to  be  a  minimizing  solution  to  (3.6): 

*  3G_  *  *  3G_  *  * 

g’  ^ik5  +  (r  }  i  rr~ (f  > 

ik  3rkj  erij 


(i,k)eL,  jeN,  i  i  j  (3.9) 
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3  G 
)rij 


T  *  ,* 


u (riJ  ' 

^1 

* 

* 

'ijCru> 

r .  . 
il 

/  * 

* 

'll  <rtj  > 

"ij 

.  >  r".  >  0 


-  (i, j)eCA  (3.10) 

*  k  k 

where  f  is  the  set  of  link  flows  corresponding  to  (r  ).  Furthermore, 

k  k 

for  any  optimal  point  (r  ,f  )  of  problem  (2.1),  there  exists  some  feasible 
routing  variable  set  $  such  that  (3.9)  and  (3.10)  hold  true. 

Proof:  First  notice  from  (3.7)  that  (3.5)  is  equivalent  to  the  following: 


gik(fik  )  + 


3G„ 


3r,  . 


k  * 

(r  ) 


*  *  * 

«  •  1  >  4iko> >  0 


3G, 


-  3r.  . 

il 


T  *  * 

1  (r  ,$  ) 


*ik<J>  =  ° 

(i,k)ei,  jeW,  j  t  i  (3.11) 


3G„ 


*  .  * 


Now  consider  theorem  2.1  and  let  S  =  ^ —  (r  ,0  ),  i,jsM,  i  #  j 


The 


ij 


sufficiency  of  the  above  conditions  follows  directly.  To  show  the  second 

k  k 

part  of  the  theorem,  let  (r  ,f  )  be  any  optimal  point  for  (2.1).  Consider 

k 

any  pair  of  nodes  i  and  j,  i  j*  j,  with  >  0.  According  to  lemma  2.2, 

the  length  of  any  active  route  R(i,j)  is  X„.  It  follows  from  (3,7)  that 

3G_  a  *  *  * 

—7 — —  (r  ,$  )  -  X..  for  s  >  0.  If  s..  *  0  for  some  i  and  j .  i  4  j . 

dr..  11  11  il 


ik 


(j)  is  not  determined  by  f  .  By  allowing  <(:  fc(j)  to  be  nonzero  only  if 


(i,k)  is  located  on  some  route  R(i,j)  with  the  length  ,  we  will  get 


3G, 


T  k  k  k 

— —  (r  ,f  )  ■  X  for  s..  =  0  also.  Again  considering  theorem  2.1  and 
rij  U  ^ 
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taking  [i  *  A^,  i,jeN,  i  +  j ,  it  follows  that  (3,9)  and  (3.10)  are  valid 
*  * 

valid  for  (r  ,  i  ) . 

3.3  a  Distributed  JFCR  Algorithm  -  Direct  Approach 


Let  (r,<}>)  be  any  feasible  point  of  (3.6).  We  define  the  algorithm  A  as 
the  product  of  two  algorithms  and  A^ ,  i.e. 

A  *  A .  .  A  (3.12) 

<P  r 

Algorithm  A  only  changes  r,  while  algorithm  A.  only  changes  $.  The  mapping 
r  ? 

(r^,$)  *  Ar(r,6)  is  a  point  to  point  mapping  as  follows: 


A 

ij 


3  J 


or .  . 

ij 


Pii(r 


(i,J)eCA  (3.13) 


r.  . 
ij 


-  r«  '  uS13  i  *13 


=  0 


<  0 


r 


ij 


> 


(3.14) 


where  U  is  a  positive  scale  factor  of  A^  to  be  discussed  later. 

Before  introducing  A.,  we  have  to  make  the  following  definition: 


Definition  3.1  :  Let  h  be  a  given  positive  number.  For  any  routing 

variable  set  i  and  any  pair  of  nodes  i,  j,  i  #  j ,  we  define  B  as 
the  set  of  all  nodes  keN  for  which  either  (i,k)^  or  d^(j)  *  0  and  k  is 
blocked  relative  to  j .  A  node  k  is  blocked  relative  to  j  if  there  exists 
a  route  R(k,j)  with  the  following  properties:  i)  For  every  link  in  R(k,j)  , 
the  routing  variable  with  respect  to  j  is  nonzero,  ii)  R(k,j)  contains 
some  link  (^»m)  for  which: 


(3.15) 
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>n  f*i 


iltn(fJ?m)  +  3r  . 


(3.16) 


We  define  another  set  8  similar  to  8  except  with  (  >  )  in  0.15)  and 


(3.16), 


Now  let  us  define  the  mapping  (r,$  )  =  AA(r,4>)  as  follows: 


*ik(j)  *  0  ;  Aik(J)  =  0  keBi< 


(3.17) 


where  S. .  is  chosen  by  node  i,  in  every  application  of  mapping  A,  arbitrarily 

A  A 

such  that  8. .c  8..  C  5  .  For  ktS. .  define: 

ij-  ij  ~  ij  r  13 


1  oG-  ,  3G_. 

a  ,  (j)  *  g.,  (f  )  +  r - min  [g.  (f .  )  +  3 —  ] 

lk  J  lk  lk  3r,  .  ,a  im  1m  3r  . 

kj  mfB  mj 


(3.18) 


A.k(j)  =  min  I*lk(J),nalk(j)/Sljl 


(3.19) 


where  h  is  a  scale  parameter  of  A^  and  is  the  same  quantity  used  in  defi¬ 
nition  3.1.  We  shall  discuss  the  proper  value  of h  later,  Let  K  .  (i,1)  be 

nun 

a  set  of  values  of  m  that  achieve  the  minimization  in  (3.18)  ,  Then: 


(3, 20. a) 


^ik(J)  >  ^k(J} 


k£Kmin(i’j) 


(3.20.b) 


N  J- 

£  ik(j)  =  1 

fit 


(3.20.C) 


Notice  that  ^ir,d)  as  defined  by  Eq,  (3.17)  -  (.3,20)  is  not  unique  since 

A 

is  not  generally  unique  and  also  for  a  given  8^  ,  ^min^'^  can  ^ave  more  than 
one  element.  Therefore  the  mapping  Aa  and  A  ■  A+  •  A  are  point  to  set 
mappings* 


4PU «****»- 
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Th.e  algorithm  A,  ,  as  defined  here,  is  a  modification  of  the 

V 

distributed  minimum  delay  routing  algorithm  proposed  by  Gallager  [4].  There 
is  an  error  in  the  proof  of  lemma  6,  appendix  C  of  [4].  The  modification 
of  and  some  respective  changes  in  the  proof  of  convergence  is  suggested 
by  Gallager  as  corrections  to  14],  The  JFCR  algorithm  A  =  A^*  A^  proposed 
here  is  a  generalization  of  the  routing  algorithm  A^. 

Theorem  3.5  Let  (r°,  $°)  be  any  feasible  point  of  (3.6)  and  let 

J(r°,$°)  <  J  .  for  each  value  J  ,  there  exist  scale  factors  p  and  D  for  A 
—  o  o  r 

and  Aj.  such  that  any  sequence  { (rIn,,iin)eA(rm  converges  to  a 

solution  of  (3.6). 


This  is  proved  in  appendix  B.  The  next  thing  is  to  see  whether 
the  computations  necessary  for  this  algorithm  can  be  conducted  distributive- 
ly  at  the  nodes  of  the  network  instead  of  being  performed  at  a  central  node. 
It  turns  out  that  a  condition  known  as  loop-freedom  is  essential  for  distri¬ 
buted  computations  of  the  algorithm  to  be  possible.  Therefore,  first  we 
shall  define  the  concept  of  loop-freedom: 

Definition  3.2  :  A  set  of  routing  variables  <fe  is  called  loop-free  if  for  any 
destination  j, there  is  no  directed  loop  in  the  network  with  links  all  having 
nonzero  routing  variables  with  respect  to  the  destination  j. 

Theorem  3.6:  If  (r°  <t>°) is  loop-free  (namely  if  <f>°  is  loop-free)  so  is 

(r®i^)£AA  (r°i>°) ,  for  any  value  of  the  scale  factor  f|  in  the  algorithm  A^ . 

This  theorem  is  proved  in  [4].  We  just  point  out  here  that  the 

A 

introduction  of  the  set  3^  in  the  algorithm  A^  was  necessary  in  order  to 
establish  this  result.  From  lemma  3.2  it  follows  that  if  (r°,t°)  is  loop- 
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free,  any  (r  ,<$  )  eA(r°,ii0)  is  also  loop-free  since  does  not  change  the 
routing  variables.  Therefore, by  induction,  (rm,$m)  *  A^Cr0^0)  is  locp-free 
for  m  »  1,2,....,  In  other  words  if  we  start  with  a  loop-free  point,  then 
the  routing  remains  loop-free  at  all  of  the  stages  of  the  algorithm  A. 

Now  let  the  routing  variables  be  loop-free  at  the  starting  point 
(and  therefore  at  all  of  the  stages)  of  the  algorithm  A.  In  order  to 
demonstrate  how  the  algorithm  may  be  performed  using  distributed  computations 
at  the  nodes  of  the  network,  let  us  first  show  the  method  of  computing 


5Ct 

— —  ,  i,je.V,  i  t  j,  distributively .  Consider  any  node  i  and  destination 
-rij 

3Gt 

T 

j  #  i.  Let  r -  be  known  at  all  nodes  m  for  which  t.  (j )  >  0  and 

mj  3Gt 

assume  that  all  such  nodes  m  send  the  value  of  ^ —  to  node  i  (over  link 


3r 


mj 


(m,i).  Once  node  i  receives 
3G„ 

compute 


r— —  for  all  m  with  (j)  >  0,  it  can 
3r  .  im 


mj 


9G„ 


z -  from  Eq.  (3.7),  This  process  of  computing  r — in  fact 

3tu  3r« 

can  be  started  at  nodes  i  which  send  all  the  traffic  s..  directlv  to  j 

3GT  13 

(namely  all  nodes  i  for  which  <5..(j)  *  1),  since  — ; —  is  zero.  Then 

ij  or,  , 

jj 

the  computation  can  be  done  for  the  nodes  i  which  send  the  traffic  s„ 

either  directly  to  j  or  to  the  nodes  of  previous  class.  This  process  can 
3G_ 


continue  until 


3r 


ij 


is  known  at  all  nodes  ieW.  For  every  destination  j , 


a  separate  process  is  necessary.  The  propertv  of  loop-freedom  is  necessarv 

3Gt 

to  avoid  deadlock  situations  where  r -  should  be  known  at  some  node  i 

3ru 

before  it  can  be  computed  at  another  node  m,  and  vice-versa,  so  that  both 
nodes  i  and  m  wait  indefinitely  for  the  other. 

3Gt 

Each  node  i,  in  the  process  of  computing  r -  ,  will  also  get 

o  r  . 

3G  ,  3G_ 

T  '  T 

Che  value  of  r -  +  g.  (f  )  for  all  m^S .  .  .Therefore,  once  —  is  known 

3r  ,  im  im  ij 

mj  ij 

at  all  nodes  i£W  for  every  destination  j£.V,  the  mapping  Ar  or  can  be 
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applied  on  the  current  (r,<f>)  and  eyerv  node  i  can  compute  the  new 

values  of  r..  or  <b.,  (j)  ,  k:  (i,k)el,  j  f  i.  Notice  that 

ij  rik  J 

in  the  algorithm  A  proposed  here,  each  of  the  two  parts  A  and  A.  should  be 
applied  on  the  network  in  separate  iterations.  It  is  certainly  desirable 
to  update  r  and  <p  both  at  the  same  iteration,  hot/ever,  the  proposed  algo¬ 
rithm  A  has  this  limitation  since  the  objective  here  was  to  show  that  the 

JFCR  problem  can  be  solved  using  iterative  and  distributed  computations, 
and  not  to  find  the  fastest  algorithm, 

3.4  A  Class  of  Distributed  JFCR  Algorithms 

Bertsekas  [16]  and  Gafni  [17]  have  recently  generalized  Gallager's 
distributed  routing  algorithm.  Their  formulations  allow  the  use  of  second 
derivative  information  and  also  provide  the  flexibility  for  our  purpose  of 
treating  the  dummy  links  of  section  3.1  differently  from  the  other  links. 

We  have  applied  the  results  of  section  3.1  to  the  class  of  algorithms  in  [17] 

to  come  up  with  the  following  class  of  distributed  JFCR  algorithms.  The 

equivalence  of  this  class  of  algorithms  with  the  routing  algorithms  of  [16] 
and  [17]  is  shown  in  appendix  B. 

Consider  the  network  M  as  modelled  in  section  2,1  and  let  us  define 


a  set  of  JFCR  variables  'p 

as  following: 

>{’ik(j)  -  flk^y 

i.jeM,  i  /  j,  Ci,k)el 

(3. 21. a) 

=  "  rij/7ij 

Ci.3)sC, 

n. 

(3.21.b) 

where  s^  *  .1 

+  ^  fmi(j) 

m :  (m ,  i )  e  L 

(3.21.C) 

i  t  j,  Ci,j)^CA 


It  follows  from  (3.21)  that: 

*ik(j)  a  1 

k: (i,k)eL 


(3. 22. a) 
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^0)1°.  1  0>  ^j.Cj)  +  £  ,JJik(j}  *  !.  (i,J)eCA  (3.22.b) 

k:  Ci,k)EL 

Definition  3.3  Let  'p  be  any  set  of  variables  ’1  (j)  which  satisfy  Eq.  (3.22). 

IK 

If  for  any  (i,j)eCA,  there  is  a  sequence  of  nodes  ifk,£,a,  m,j  for  which 

w  (j)  >  0,  ,  (j )  >  0,..  tp  .  (j)  >  0,  then  is  called  a  JFCR  variable  set. 

IK  KX  mj 


Theorem  3.7:  Given  the  set  of  desired  input  rates  fi,  any  set  of  JFCR  vari¬ 
ables  y  corresponds  to  a  unique  set  of  input  rates  r  and  multicommodity 
flows  f. 

This  lemma  is  proved  in  appendix  B.  Now  let 


3G„ 


’  8Vflt>  + 


i,  jeW,  i  j4  j  .  (i ,k) eL 


For  any  pair  of  nodes  i  and  j  ,  i  #  j,  define  two  column  vectors  $  and 
Y^  respectively  with  entries  and  Y^Cj),  (i,k)£l,  in  any  fixed  order. 


ik 


If  (i,j)eC  ,  we  extend  the  dimension  of  £.  .  and  Y-.  by  one  to  include  respect- 
A  ll  11 

ivelv  r. '  (j )  and  p..(r..)  as  their  last  entry. 
il  il  il 

For  any  set  of  JFCR  variables  ’1  and  any  node  i  ,  we  define  a 

node  k  as  blocked  with  respect  to  destination  j  if  (i,k)oL  and 

3Gt  3gt 

<  - -  or  there  exists  a  route  R(k,j),  with 


vik 


(j) 


0  and  either 


or . 


il 


kl 


nonzero  JFCR  variables  on  each  part  it,  which  contains  some  link  (i,m)  with 


3G., 


3G„ 


or . 


—  or 


mi 


For  any  given  ’■P  ,  we  denote  by  5_  the  set  of  all 


blocked  nodes  with  respect  to  node  i  and  destination  j. 

Now  the  clas  of  JFCR  algorithms  A,  are  as  follows:  In  each 

V 

iteration,  in  order  to  map  the  current  point  ’p  into  the  new  point  A^Oi1),  at 
each  node  i  and  for  every  destination  j  the  following  optimization  problem 


is  solved 


min 

A 

* 


V  -Mu 


subject  to 


i)  ’J:  satisfies  Eq.  (3.22) 

/A, 

ii)  (j)  =0  for  keo^ 


where  a  >  0  is  a  scale  factor  and  M  is  a  symmetric  matrix  of  proper  dimen¬ 
sion  that  can  be  a  function  of  C  and  the  .iteration,  but  must  satisfy  the 
following  constraints  for  some  fixed  A  >  0,  z  >  0:  First  the  elements  of 

. >  say  m  ,  must  satisfy  I m  ,  t  <  A.  Secondlv  M. .  should  satisfy 
ij  p*.  |  pi!  —  ij  1 

>1  »  •  2 

e;  |Vj  i  _<_  vc  .  *  v  for  all  vectors  v  of  proper  dimension  which  have 

a  zero  component  on  places  corresponding  to  nodes  kcB... 


Theorem  3.8:  Assume  that  lim  e  (r  )  =  ».  i.ieC  <  Let  'j;  be  anv 

r..-0  ij  A 

JFCR  variable  set  corresponding  to  a  feasible  point  (r°,v>°)  with  J(r°,d°)  <J  . 

o 

For  each  value  of  J  ,  there  exists  a  positive  value  for  a  such  that  anv 
o 

‘.'i  =  A^(y>°):  converges  to  a  solution  of  (2.1).  Furthermore,  if 

y  corresponds  to  a  loop-free  routing,  so  does  -L  ,  m  =  1,2,,,, 

This  theorem  is  proved  in  appendix  B.  Since  the  JFCR  variable  set  i 
is  loop-free  at  every  stage  of  the  algorithm,  the  distributed  computation  of 


sequence 
.  o 


A,  is  possible. 

V 
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CHAPTER  IV 

THE  USE  OF  WINDOW  STRATEGY  FOR  IMPLEMENTATION  OF  JFCR  STRATEGY 

In  this  chapter  we  discuss  three  distinct  problems  regarding  the 
implementation  of  the  JFCR  strategy  and  its  effectiveness  in  controlling 
the  flow  of  traffic  in  the  network.  The  first  problem  is  that  of  adjusting 
the  input  rates  of  different  commodities  to  the  values  assigned  by  the  JFCP. 
strategy.  We  prove  that  a  flow  control  mechanism  known  as  widow  strategy  - 
wdiich  has  been  in  the  literature  for  some  time  -  is  an  effective  way  of  ad¬ 
justing  the  input  rates  to  the  set  of  assigned  values. 

Next, we  discuss  the  behavior  of  the  JFCR  algorithm  in  a  quasi-sta¬ 
tic  situation  where  the  statistics  of  arriving  traffic  changes  slowly  with 
time.  Finally,  we  consider  the  short-term  fluctuations  of  the  traffic  and 
show  that  while  the  JFCR  strategy  itself  is  not  capable  of  reacting  to  the 
fast  fluctuations  of  the  traffic,  the  window  strategy  employed  for  the  input 
rate  adjustment,  effectively  reduces  the  danger  of  congestion  caused  by  fast 
changes  of  traffic. 

4 . The  Window  Strategy  for  Input  Rate  Adjustment 

The  strategy  developed  in  the  foregoinf  chapters,  aims  at  maintain¬ 
ing  an  appropriate  and  noncongesting  traffic  in  the  network,  through  assign¬ 
ing  a  set  of  optimal  input  rates  to  the  commodities.  It  is  simply  assumed 
there  that  the  average  rate  of  the  incoming  messages  on  each  commodity  (i,j) 

can  be  set  to  anv  value  on  some  interval  [0,1..],  and  the  difficulties  in- 

lj 

volved  in  the  actual  implementation  are  not  considered.  Our  objective  in 
this  section  is  to  propose  an  appropriate  mechanism  for  adjusting  the  input 
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rates  to  the  assigned  values. 

Consider  any  commodity  (i,j)  with  the  desired  input  rate  l  and 
the  allowed  throughput  r^  <_  ^  assigned  by  the  flow  control  strategy. 
Accordingly,  there  must  be  some  controlling  device  at  the  entrance  of  node 
i  which  will  accept  some  of  the  incoming  traffic  into  the  network  and  re- 

4. 

ject  the  rest.  It  is  .therefore, necessary  to  define  the  rules  according  to 
which  the  decision  about  acceptance  or  rejection  of  the  incoming  messages 

XX 

should  be  made  in  order  to  maintain  the  input  rate  r .  The  window  stra¬ 
tegy  is  a  flow  control  scheme  which  provides  such  rules.  In  the  present 

section,  first  we  explain  what  this  strategy  is  and  then  discuss  its  appli¬ 
cation  for  our  purpose. 

Let  us  first  define  a  term  which  will  be  used  in  the  explanation 
of  the  window  strategy.  At  a  given  time  an  "outstanding  packet"  in  the 
network  is  one  which  has  already  entered  the  network  and  either  it  has  not 
yet  arrived  at  the  destination  or  its  acknowledgment  has  not  yet  been  receiv¬ 
ed  by  the  source  node. 

The  window  strategy  refers  to  a  control  scheme  in  which  each 
source  node  i,  keeps  the  number  of  the  outstanding  messages  of  each  commodi¬ 
ty  (i»j)  below  a  given  number  w  ,  called  the  window  size  of  commodity  (i,j). 

If  storage  capacity  is  available,  the  rejected  traffic  can  be  queued  at  the 
entrance  of  the  network  until  it  can  be  accepted  into  the  network. 


The  arrival  rate  of  commodity  (i,j)  at  node  i,  is  not  equal  to  the  desi¬ 
red  input  rate  A  in  general.  It  depends  on  the  nature  of  the  source  and 

on  the  value  of  r  as  well  as  .  For  example,  if  a  human  being  is  at  the 

source  of  the  commodity,  a  small  assigned  throughput  r„  can  discourage  him 

from  sending  data.  On  the  other  hand,  if  the  source  is  a  computer  which  con¬ 
sistently  tries  to  send  some  data,  the  arrival  rate  would  include  both  the 
traffic  that  is  arriving  for  the  first  time  and  the  traffic  that  has  not  gone 
through  before,  and  therefore  is  bigger  than  ^ . 

In  any  case, it  is  reasonable  for  our  purpose  to  assume  that  the  arrival 
rate  is  greater  than  or  equal  to  r^  for  r^  <_  -1^ . 
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Accordingly,  whenever  a  new  message  arrives  for  commodity  (-i,j),  it  can 

enter  the  network  if  the  number  of  outstanding  packets  of  commodity  (i,j) 

at  that  time  is  less  than  w.  . .  If  this  number  is  ecual  to  w..,  no  packet 

ij  Jj 

of  commodity  (i,j)  can  enter  the  network  until  an  acknowledgment  from  node 
j  is  received  by  i,  indicating  that  a  new  packet  of  this  commodity  has 
reached  the  destination. 

To  our  knowledge  this  strategy  was  first  proposed  by  Cerf  and 
Kahn  [10]  and  later  on  discussed  by  Gerla  and  Chou  [14]  as  a  mechanism  for 
congestion  control  in  data  communication  networks.lt  was  argued  that  a  set 
of  appropriate  window  sizes  for  different  commodities  would  provide  an 
effective  flow  control  in  the  network.  The  proposals,  however,  did  not  say 
much  about  the  criteria  or  computation  of  an  appropriate  set  of  window  sizes. 

Here  we  link  the  window’  strategy  and  the  JFCR  strategy  together, 
by  showing  that  it  is  possible  to  maintain  any  assigned  set  of  input  rates 
r  (which  is  demanded  at  some  stage  of  the  JFCR  algorithm)  through  implement¬ 
ing  the  window  strategy  with  an  appropriate  set  of  window  sizes.  In  other 
words,  we  show  that  for  any  set  of  feasible  input  rates  r,  there  exists  a 

set  of  window  sizes  w  =  {w  I  ( i ,  j)eC  } ,  such  that  the  implementation  of  the 

A 

window  strategy  using  these  windows  will  force  the  input  rates  to  become 
equal  to  r. 

We  will  spend  the  rest  of  this  section  verifying  the  above  claim. 

In  doing  so,  first  we  need  to  obtain  the  relationship  between  the  average 
number  of  outstanding  packets  and  the  rate  of  commodities  in  the  network. 
Later  on,  in  Section  4.4,  we  will  discuss  the  interesting  features  of  the 
window  strategy  and  explain  why  we  have  proposed  it  for  maintaining  the 
desired  set  of  input  rates  in  the  network. 


Consider  the  network  M  with  some  given  set  of  routing  variables 
$.  Let  K  be  the  number  of  active  commodities  of  the  network.  For  the  sake 
of  notational  simplicity,  in  this  section  we  will  mostly  use  a  single  sub¬ 
script  k  =  1,2,...  K,  in  order  to  refer  to  an  active  commodity  instead  of 
specifying  it  with  its  source  and  destination  pair  (i,j).  Thus  r^,  for 
example,  represents  the  rate  of  commodity  k.  Let  n^  (n^  )  be  the  expected 
number  of  the  outstanding  packets  of  commodity  k  (commodity  (i,j)).  This 
number  consists  of  two  parts.  The  first  part,  which  we  shall  denote  by 
n^  ,  is  the  average  number  of  packets  of  commodity  k  at  any  given  time, 

which  have  entered  the  network  and  have  not  reached  the  destination.  The 
2 

second  part,  n^,  is  the  average  number  of  packets  of  the  commodity  which 
have  reached  the  destination  but  whose  acknowledgment  has  not  yet  reached 
the  source  node. 

Fot  the  given  set  of  routing  variables  $>,  let  us  define  the  rout¬ 
ing  matrix  Q,  with  dimensions  K  x  L,  as  follows:  Each  component  q  ^  of  Q 

denotes  the  fraction  of  commodity  k  which  passes  through  link  £,  The  £'th 
£  K 

column  of  Q,q  €H  specifies  the  fractions  of  different  commodities  pass¬ 
ing  through  link  i.  Similarly  the  k'th  row  of  Q,  q^GIR^  shows  how  commodi¬ 
ty  k  is  routed  through  the  network.  With  this  definition,  it  follows  from 
Little's  formula  that  the  average  number  of  packets  of  commodity  k, 

waiting  or  being  transmitted  on  link  £  ,  is  y-  r^.q^.t^  for  k  =  1,..  K 
and  i  *  1, . . ,L,  where  V  is  the  average  length  in  bits  of  packets  and  t^ 

X 

In  specifying  matrix  Q  in  terms  of  <t>  it  is  reasonable  to  assume  that  the 
traffic  is  routed  through  the  network  regardless  of  the  source  that  each 
packet  is  originated  from  and  based  only  on  the  destination.  With  this 
assumption  ,  each  routing  variable  see  $  specifies  the  routing  table  of  every 

single  commodity  as  well  as  the  overall  traffic  and,  therefore , corresponds  to 
a  unique  routing  matrix  Q. 


denotes  the  average  delay  per  packet  that  commodity  k  undergoes, waiting 
or  being  transmitted  on  link  l. 


In  order  to  avoid  statistical  analysis  of  the  queues  of  the  net¬ 
work,  which  is  very  hard  when  flow  control  is  practiced  even  under  many 
simplifying  assumptions,  we  assume  that  on  each  link  the  average  delay  per 

X 

packet  experienced  by  different  commodities  is  the  same.  Therefore, 
ck£.  ”  C£  k  =  1, . .  ,K  ,  l  =  1,...,L 

With  this  assumption  we  can  conclude  from  the  above  results  that: 


1  1 
nk  -  r  rk 


£-1 


f  *  rk  *  \  C 


(4.1) 


where  t€  E  is  a  column  vector  consisting  of  the  components  t. 


Instead  of  writing  Little's  formula  for  every  single  link,  we  can 
consider  the  whole  network  as  a  single  server  for  commodity  k  and  apply 
Little's  formula  to  it  to  see  that: 


1  _  1 

nk  r  •  rk  •  Tk 


(4.2) 


where  x^  represents  the  average  delay  per  packet  for  commodity  k  when 
travelling  through  the  network.  Now  by  comparing  (4.1)  and  (4.2)  we  get: 


Xk  =  qk  •  t  (4.3) 

2 

In  order  to  compute  n.  ,  let  us  denote  bv  0  the  average  time 

k  '  k 

between  the  moment  that  a  packet  of  commodity  k  arrives  at  the  destination 
and  the  moment  that  the  corresponding  acknowledgment  is  received  by  the 


This  assumption  is  not  true  in  general,  despite  looking  trivial.  Suppos¬ 
ing  that  the  service  times  of  each  packet  at  different  links  are  exponential¬ 
ly  distributed  and  statistically  independent,  we  have  been  able  to  use  the 


results  of  [IS]  and  show  that 


"k£ 


tj  for  all  £  3  1,...,L  and 


k  *  1,..,K,  if  a  window  strategy  is  not  practiced  and  the  arrival  of  packets 
of  each  commodity  is  poisson.  But  if  the  window  strategy  is  imposed  even  on 
some  of  the  commodities,  the  assumption  is  not  valid.  Nevertheless,  we 
think  it  is  a  reasonable  approximation,  especially  since  an  exact  analysis 
has  been  impossible. 
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source  node.  By  applying  the  same  concept  one  can  see  that: 


Therefore: 


n2  1 

n  *  —  r 

k  r  k 


1  .  2 
nk  +  \ 


f  rk  (Tk  +  V 


(4.4) 

(4.5) 


In  the  following  two  cases  we  continue  our  analysis  under  two  different 
assumptions,  with  respect  to  the  time  necessary  for  the  acknowledgments  to 
reach  the  source  nodes.  In  both  cases  it  is  assumed  that  the  acknowledg¬ 
ments  do  not  add  to  the  traffic  of  the  network.  This  is  reasonable  if  data 
packets  contain  a  field  for  acknowledgment  of  other  packets. 


CASE  1  -  0,  is  fixed  and  independent  of  the  network's  traffic: 

This  case  is  approximately  valid  if  the  acknowledgments  are  consi¬ 
dered  as  high  priority  protocols  when  passing  through  the  network  and  at 
each  node  are  inserted  into  the  first  packet  on  the  next  link  on  a  pat  to 

*r 

the  right  destination.  When  we  consider  the  next  case,  we  will  see  that 
the  assumption  in  this  case  is  important  in  order  to  maintain  a  stable 

situation  in  the  network.  With  the  assumption  made  here,  and  for  a  given 

routing  variable  set  d,  Eq.  (4.3)  and  (4.5)  completely  describe  in  terms 

of  the  input  rates  r  ,  m  =  1,...,K,  through  the  functions  t,  (f,  ) , 

l  ■  1,...,L.  Therefore  we  can  view  (4.3)  and  (4.5)  as  the  following  mapping 

from  1RK  to  : 

n*  =  h(r)  (4.6) 

,  y  i  K 

where  n€  It  and  r&  H  are  two  column  vectors  with  the  k'th  components  n^ 
and  r^  respectively. 

X 

When  there  is  no  packet  going  on  such  a  link,  a  special  protocol  packet 
should  be  formed  to  send  the  acknowledgment  over  that  link. 
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Theorem  4.1  :  Let  Z  *  1,.,.,L,  be  an  increasing  and  continuously 

differentiable  function  on  [O.C^).  Assume  that  t^  (0)  >  0  for  Z  *  1,...,L, 
and  9 ^  >_  0  for  k  *■  1,...,K.  For  a  given  routing  matrix  Q,  define  V  as  the 
set  of  feasible  inputs  r  ,  i.e. 


V  ■  (rjr  >_  0  and 


k=l 


rk  •  V"  h 


1 . L  I 


where  is  the  effective  capacity  of  link  Z  as  defined  in  section  2.2. 

Then  there  exists  a  one  to  one  correspondence  between  the  points  in  V  and 
h(P),  i.e. 

h(r)  *  n  ,  r  e  V  _  ^ 

»  r  =  r ' 

h  ( r ' )  «  n ,  r'  £  V 

Furthermore , the  inverse  function  r  =  h  ^(n)  is  continuously  differentiable 


on  h(fl)  and  its  derivative  with  respect  to  r  is  the  inverse  of 


This  theorem  is  proved  in  Appendix  C. 


dh(r) 

-* 

dr 


CASE  2  -  Equal  priority  in  the  transmission  of  acknowledgments  and  other 

data: 

An  alternative  to  our  assumption  of  giving  high  priority  to  the 

service  of  acknowledgments  is  to  route  them  through  the  network  and  serve 

them  at  the  links  with  the  same  priorities  as  other  traffic.  In  this  case, 

if  we  assume  that  the  average  length  of  packets  containing  acknowledgments 

is  equal  to  the  average  length  of  other  packets,  it  follows  that  9  *  Tji’ 

(i, j )€ C  .  Notice  that  if  (j,i)  does  not  denote  an  active  commodity,  still 
A 

we  can  define  T..  as  the  exoected  travelling  time  between  j  and  i. 

ji 

In  this  case  8  ..  is  not  constant  and  is  a  function  of  the  traffic 
ij 

in  the  network.  In  order  to  obtain  this  function,  let  the  source-destina- 
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tion  pair  (i,j)  correspond  to  the  commodity  k.  Let  us  define’e  the  row 
vector  v^6  with  the  A’th  entry  showing  the  portion  of  commodity  (j,i) 
which  goes  through  the  link  H.  0^  can  be  expressed  then  as: 


8 


k 


(A. 7) 


It  is  clear  that  if  (j,i)  denotes  an  -active  commodity,  is  equal  to  that 
row  of  Q  which  corresponds  to  commodity  (j,i).  Equations  (4.3),  (4.5)  and 
(4.7)  imply  that: 


n 


k 


(vk  +  qk} 


k  =  1, . .. ,K  (4.8) 


In  appendix  C,  Eq.  (4.7)  is  used  to  show  that  when  fl  .  *  T, .  , 

*  rr  ij  Ji 

(i,j)£CA>  there  is  no  longer  a  unique  correspondence  between  r  and  n 

4-  4  . 

and  for  a  given  n  there  may  exist  multiple  inputs  rcV  satisfying 
n  “  h(r) . 

Theorem  4.1  suggests  that  in  a  nerwork  where  the  acknowledgments 

are  given  high  priority  in  service,  one  way  of  adjusting  the  input  rates 

* 

to  a  set  of  desired  values  r  ,  is  to  keep  the  expected  number  of  outstand- 

* 

ing  packets  of  each  commodity  (i,j)  at  the  value  corresponding  to  r  , 

-4  -4*  -4* 

namely  to  have  n  *  n  *  h(r  ). 

The  window  strategy  provides  an  effective  means  for  controlling 

■4  ★  - 

the  value  of  n.  Suppose  that  we  choose  w. .  =  n..  for  all  (i,j)el  .  This 

1J  IJ  A 

implies  that  the  number  of  outstanding  packets  of  any  active  commodity  (i,j) 

★ 

will  always  be  equal  to  or  smaller  than  *  n„  .  If  we  further  assume 

that  on  each  active  commodity  (i,j),  there  are  always  some  messages  waiting 

to  enter  the  network,  then  as  soon  as  a  new  acknowledgment  arrives  at  node 

i,  a  new  packet  enters  the  network  and  the  number  of  outstanding  packets 

* 

will  always  stay  at  w^j  *  n^  .  Therefore  the  expected  number  of  out- 
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standing  packets,  n..,  will  also  become  equal  to  the  desired  value  n... 

J  ij 

According  to  theorem  4.1  it  follows  that: 


r .  .  =  r .  . 

ij  ij 


(i ,  j )  eC 


If  the  acknowledgments  in  the  network  do  not  possess  high  priority 


in  service,  theorem  4.1  does  not  apply.  Indeed  in  this  case,  as  we  pointed 

-+•  -*■* 


out  earlier,  enforcing  the  value  of  n  to  the  desired  value  n  through  the 
implementation  of  the  window  strategy,  does  not  necessarily  guarantee  that 
r  =  r  and  in  fact  might  allow  multiple  points  r  corresponding  to  the 
same  value  of  n  =  n  .  Thus, the  window  strategy  is  not  necessarily  an 
effective  way  of  adjusting  the  input  rates  in  this  case. 

The  impact  of  the  above  results  goes  beyond  the  scope  of  the 
implementation  of  the  window  strategy  for  achieving  a  desired  set  of  input 
rates.  In  fact  if  there  are  multiple  choices  for  r  with  a  given  set  of 
windows,  the  statistical  behavior  of  the  network  makes  it  possible  for  the 
input  rates  to  oscillate  back  and  forth  between  several  points.  Therefore 
in  order  to  maintain  a  stable  situation  in  the  network,  wherever  windowing 
is  implemented,  the  acknowledgments  should  have  high  priority  in  service  so 
that  their  expected  travelling  time  becomes  independent  of  the  level  of 
traffic  in  the  network. 

In  the  foregoing  discussion,  in  order  to  conclude  that  n„  *  w„  , 

we  assumed  that  there  are  always  some  messages  waiting  to  enter  the  network 

for  commodity  (i,j).  This  assumption  is  reasonable  if  for  every  commodity 

there  is  a  sufficiently  large  buffer  located  before  the  flow  control  device 

where  the  arriving  messages  can  be  queued  until  they  are  accepted  by  the 

network.  Of  course,  with  this  buffer,  the  actual  delay  of  commodity  (i,j) 

is  more  than  T . .  .  We  have  not,  however,  introduced  this  additional  delav 
lj 

into  our  JFCR  formulation  (Eq.  2.1),  since  this  delay  depends  on  ancj 
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as  explained  in  section  2.5,  we  would  like  to  keep  the  assigned  input  rate 

r  independent  of  A..  (except  for  the  constraint  r..  <  A.  ). 

ij  —  1  j 

Notice  that  even  with  this  buffer,  as  the  assigned  input  rate  r*. 

approaches  the  corresponding  upper  bound  *  ,  the  likelihood  that  the 

buffer  is  empty  at  a  given  time  increases,  and  therefore  the  expected  number 

of  outstanding  packets,  n,.,  will  become  smaller  than  w  *  n...  Accordine- 

ij  ij  ij  5 

ly  the  actual  rate  r..  will  be  somewhat  less  than  r..  (Fig.  4.1)- 

ij  ij  6 


A  more  important  source  of  error  in  adjusting  r ,  .  to  r..  for 

ij  ij 

many  cases  of  practical  importance  is  the  approximation  involved  in  choosing 

* 

an  integer  value  for  when  n^  is  not  integer.  This  error  becomes 

* 

particularly  significant  when  n„  is  a  fraction  of  unity.  One  possible  wav 

of  correcting  this  type  of  error  is  to  change  9„  artificially  to  some 
1  *  2.  ^ 

larger  value  8  for  which  n.,  *  —  r . .  (t . .  +  6! . )  is  an  integer.  This 

ij  ij  i  ij  ’  ij  ij  5 

can  be  done  by  disregarding  any  received  acknowledgment  at  node  i  (from 


node  j )  for  3’  -  9. , 

ij  ij 


seconds . 
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4.2  Distributed  Computation  of  Window  Sizes: 


Given  a  set  of  assigned  input  rates  r,  Eq,  (4.5)  shows  how  the 
appropriate  window  size  ,  (i.  j  )eCa>  can  ke  computed.  This  closed  form 
relationship  is  inappropriate  for  a  distributed  computation  of  the  window 
sizes.  In  order  to  comput  w^  distributively ,  we  notice  that  T„  can  be 
expressed  as  follows: 


Tii  *  *ik(J)  (tik  +  T.  ) 

k:(i,k)el  1K  llc 


(4.9) 


where  T  denotes  the  expected  travelling  time  between  k  and  j  ,  for 
any  (k,j)  whether  it  represents  an  active  commodity  or  not.  Naturally,  we 
take  T  *  0 ,  1  *  1.....N. 

2i 

The  similarity  between  Eq.  (4.9)  and  Eq.  (3.7)  suggests  that 

T  ,  can  be  computed  distributively  in  the  same  way  that  was  explained  in 

T 

Section  3.3  for  the  distributed  computation  of  x -  .  This, indeed  is 

3rij 

possible  for  a  loop-free  case,  which  is  the  case  under  our  consideration: 

For  any  destination  j,  every  node  i  ^  j  should  wait  until  it  receives 

from  all  the  adjacent  and  downstream  nodes  k  (downstream  with  respect 

to  j).  Node  i  itself  can  measure  or  calculate  the  value  of  t..  for  all 

lk 

(i,k )zL.  Then  it  can  compute  from  (4.9)  and  in  turn  send  it  to  all 

of  the  adjacent  nodes.  This  process  continues  until  is  known  at  every 

node  i  and  for  every  destination  j.  Each  node  i  then  uses  T 
in  adjusting  the  window  size. 

In  the  above  explanation  we  tried  to  demonstrate  that  the  distri¬ 
buted  computation  of  window  sizes  is  possible.  There  are,  however,  some 


problems  involved  in  this  computation  that  we  have  neglected.  To  explain 
these  problems  let  us  consider  the  network  after  the  ra'th  iteration  of  the 


i  ,  _ ,  t  a  ,  m  m  „m  m 

algorithm.  Let  r  ,  $  ,  t  ,  w  ,  r 

3-J  KJ 


for  k.jcW,  i:(i,j)eC.. 


denote  the  parameters  of  the  network  at  this  stage.  For  the  next  iteration 
it  is  necessary  to  comput  w™*1  »  F  *  rij+1  *  ^ij"1  +  9ij^’  for  (i,j)eCA. 


nH-1  ,  ,  m+1  ,  ,  m+1 

is  a  function  of  t  and  <j>  as  we  have 


^m+1 

ij 


Ejn+L  •  \  /_®+l  ,  m+1  . 

^ikU)  (*„  +  t,,_  ) 


k: (i,k)e  L 


kj 


’ik 


(4.10) 


Therefore,  in  order  to  compute  both  and  tm+''"  are  needed.  The 

following  procedure  describes  the  distributed  computations  which  are 
necessary  in  order  to  compute  and  w  ,  (i,j)eC^  . 


i) 

ii) 


perform  the  distributed  procedure  of  computing  and  rm+^  • 

every  node  i  should  inform  all  of  its  adjacent  nodes  k,  whether 
or  not  the  routing  variables  >  j  t  i,  are  zero. 

Thus  every  node  k  will  know  what  its  adjacent  upstream  nodes 
with  respect  to  different  destinations  will  be  in  the  next 
iteration. 


iii)  Perform  the  following  distributed  computations  to  find  , 

(i,k)el.  -For  each  destination  j,  every  node  i  waits  until 
it  receives  f  (j)  from  all  the  adjacent  upstream  nodes  k 
and  then  obtains  r™"!"1  +  5^  fFt^Cj),  Then  node  i 

13  13  k:(kTi)€l 

informs  all  of  the  adjacent  nodes  k  of  the  value  of 


By  one  iteration  we  refer  to  any  step  of  the  algorithm  in  which  a  new 
update  of  the  cost  differentials  3G^/3r^  ,  (i,j)eCA  is  necessary.  In 

this  sense,  one  iteration  of  the  algorithm  proposed  in  Section  3.3, 
corresponds  to  one  application  of  the  mapping  Aj>  or  and  not  to  one 
application  of  the  mapping  A  *  .  Ar 
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f^Cj)  -  s^1  •  4>^1(j)  for  all  jeW,  j#i.  Once  f^1  (j)  is 


known  for  all  (i,k )eL,  j zN,  i  #  j,  every  node  i  can  compute 

L 


,m+l  ,m-n , . . 

f--  "  L  fik  (j)* 


’ik 


iv)  Having  the  value  of  f?^  ,  each  node  i  can  find  t”^(f^  )  either 


'ik  ik 

analytically,  if  the  function  t^  (f^)  is  known,  or  using  the 
following  approximation: 


te)'- 


cn+1  =  tm  + 
ik  ik 


-  fIk> 


wher 


a  ^  *nd  te) 


are  estimated  by  node  i. 


„m+l 


v)  Now  the  previously  explained  procedure  for  computing  based 


on  the  values  of  and  t^j^- 


can  take  place,  and  then 


every  node  i  can  compute  the  window  sizes  w 


m+1 


ij 


~  V1^1  +  9  )  for  all  U.j)eCA 

r  ii  ij  ii  A 


As  is  evident,  the  distributed  computations  described  above  require 
alomost  three  times  the  protocol  transmission  compared  to  the  distributed 


computations  of  just  updating  $  and/or  r.  This  increase  is  due  to  the 


m+1 


additional  computations  necessary  to  find  T  .  If  one  is  willing  to 


accept  some  approximation,  it  is  possible  to  use  a  simpler  and  faster  pro¬ 


cedure  for  finding  tT!"^  and  wTl"^,  (i,j  )eC  : 

lj  ij  A 


,  m+1  ,  .  . .  ra+1 

As  an  approximation  to  x^  ,  let  us  define  x_  as: 


^m+1 

Tij 


k:  (i,k)ei 


CJ)  (S1  +  t“k)  i,  jeM  ,  i  *  j  (4.11) 


ik 


-,v  '■,« 


T  would  be  the  expected  travelling  time  between  i  and  j  ,  if  the 
routing  variable  set  was  $ID+^'  but  the  link  flows  were  fm.  It  is  possible 
to  compute  distributively  in  parallel  with  the  computation  of  rm+^ 


.  ,  m+1 

ana  *  < 

receives  both 


For  everv  destination  j  ,  each  node  i  waits  until  it 
/  3Q  \a 
—  )  and 
rkj  /  Tkj 


from  all  of  the  adjacent  downstream  nodes 


..m+1 


k.  Then  node  i  first  computes  $..  (j)  for  all  (i,k)cL,  and  then  obtains 

ltc  /sr.  \m 


m 

x  so'. 


to  all 


the  value  of  from  (4.11).  Finally  it  sends  t”*1  and 

of  the  adjacent  nodes.  The  process  continues  until  and 

known  for  all  i,j£.‘i,  i  #  j,  (i,k)eL  .  Then  the  input  rates  and  window  sizes 
can  be  updated  easily. 


m+1 , . . 
ik  (J>  are 


Finally  an  even  simpler  method  of  computing  the  window  sizes  is  to 
measure  the  round  trip  delay  T„  +  0  „  directly  at  the  node  i  ,  and  use 
this  value  to  compute  w  ^  for  the  next  iteration,  which  means  using 

w®*1  *  i’r^1  .  (t®  +8..)  as  the  window  size  of  commodity  (i,j)  at 

*  ij  ij  ij 

iteration  (nrl-1) .  This  involves  more  approximation  compared  to  the  previous 

IQ  ^-|i  |  i 

case  since  i^  used  to  compute  w ^  .  A  more  serious  problem  here  is 

that  the  average  round  trip  delays  can  be  estimated  less  accurately  over  a 
given  interval  than  the  link  delays  since  the  link  flows  generally  combine 
many  commodities  and  thus  generally  contain  more  packets  per  unit  time. 


4 . 3  Quasi-Static  Behavior  of  the  JFCR.  Strategy 

The  JFCR  strategy  and  the  algorithm  developed  in  chapters  II  and  III 
are  based  on  the  assumption  that  the  input  statistics  and  the  link  capa¬ 
cities  of  the  network  do  not  vary  with  time.  This  assumption  is  reflected 
in  a  fixed  set  of  active  commodities  C and  a  fixed  set  of  desired  input 


rates  H.  The  algorithm  is  intended  however  for  quasi-static  applications 
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where,  as  time  goes  on,  the  desired  input  rates  change  slowly  and  also  new 
commodities  become  active  gradually. or  some  of  the  active  commodities  become 
silent. 

While  the  convergence  of  the  algorithm  under  these  conditions  is 
subject  to  question,  it  can  be  applied  to  the  quasi-static  case  with  slight 
modification  in  the  procedure  of  the  algorithm.  To  discuss  this  necessary 
modification,  consider  the  network  just  before  an  update  of  the  input  rates 
and  let  C and  A  respectively  represent  the  set  of  active  commodities 
and  the  set  of  desired  input  rates  at  this  moment.  Let  r  be  assigned  as 
the  set  of  input  rates  after  this  update.  Until  the  next  update  the 
following  quasi-static  changes  might  occur  in  the  network: 


a) .  Some  of  the  desired  input  rates  may  increase  and  new  commodities 
may  become  active, 

b)  Some  of  the  desired  input  rates  may  decrease.  This  reduction  for 
some  of  the  commodities  may  be  sufficient  to  reduce  the  new  desired  input 
rate  to  less  than  the  assigned  rate.  At  the  limit,  som;  of  the  commodities 
may  become  totally  silent. 


Clearly  if  case  a,  b  or  both  occurs, each  source  node  i  at  the  next 
update  of  the  algorithm  should  consider  the  active  commodities  at  that  time 
and  should  calculate  and  assign  their  new  input  rates,  based  on  the  most 
recent  values  of  the  corresponding  desired  rates  (Eq,  3,14).  Additional 


considerations  are  necessary,  however,  due  to  the  possibility  of  case  b. 
Suppose  that  for  some  commodity  (i,j),  the  desired  input  rate  in  the  time 


interval  between  two  updates  decreases  from  A^  to  some  value  less  than 
the  input  rate  r^  assigned  at  the  first  update,  Clearly  then  the  actual 
input  rate  of  commodity  (i,j)  in  this  interval  will  be  less  than  r  . 


-67- 


Let  r„  (real)  denote  this  actual  input  rate  in  contrast  with  the 

nominal  value  r^  assigned  by  the  algorithm.  During  the  interval  under 

consideration,  the  measurement  of  the  marginal  link  costs  and  the  cost 

3Gt 

differentials  g —  is  based  on  the  actual  traffic  passing  through  the 

rij 

network  and  not  on  the  traffic  specified  by  the  nominal  input  rates  r  , 
(i,j)cCA.  Therefore, at  the  next  update  of  the  algorithm,  the  new  input 
rate  r^  should  also  be  computed  based  on  the  actual  input  rate  r„  (real) 
and  not  the  nominal  value  r  „  .  Accordingly,  Eq,  (3.13)  and  (3.14)  should 
be  modified  as  follows: 


'ij 


3J 

3r.  . 
ij 


r . .  =  r . . (real) 
ij  ij 


r . .  ■  r . . (real) 
ij  ij 


pii  ‘V 


ry  ■  ry  (r*al> 


(4.12) 


ij  *  rij(real)  "y6ij’  0<r  (raaD-Uiy  <  n.±. 


0 

K. 


IJ 


r.  .  (real)  -]i5.  .  <  0 
ij  iJ  - 

r^CteaD-uSy  > 


(4.13) 


Here  ,  denotes  the  most  recent  value  of  the  desired  input  rate. 

The  variations  of  r^.  and  r^  (real)  with  respect  to  time  are  illustra¬ 
ted  in  Fig.  4.2  for  two  types  of  behavior  of  .  In  both  cases  it  is 
assumed  that  stays  below  the  amount  of  service  which  the  JFCR  strate¬ 

gy  can  potentially  offer.  More  precisely,  it  is  assumed  that  <5^  as 
defined  by  Eq.  (4.12)  is  always  negative.  in  case  a,  where  changes 
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gradually  with  time,  the  algorithm  is  able  to  keep  up  with  it.  In  case  b, 
when  suddenly  increaes,it  takes  some  time  until  the  appropriate  input 

rate  is  assigned  to  the  commodity,  while  on  the  falling  edge,  r^  follows 
almost  immediately.  This  case  illustrates  an  important  shortcoming  of 
the  proposed  JFCR  strategy:  When  a  big  user  of  the  network,  which  is  in¬ 
active  for  a  while,  suddenly  becomes  active,  it  may  take  a  long  time  before 
the  proper  input  rate  is  assigned  to  it.  To  solve  this  problem, one  alter¬ 
native  is  to  leave  the  window  si2es  large  when  the  desired  input  rates  have 
become  too  small  compared  to  the  active  periods.  But  this  has  the  dis¬ 
advantage  of  exposing  the  network  Co  congestion  when  many  such  commodities 
become  active  altogether.  Further  investigations  are  necessary  to  find  an 
appropriate  way  of  handling  the  trade-off  between  the  difficulties  of  above 
two  alternatives. 

The  difference  between  r„  and  r  (real)  is  not  merely  caused  by  the 

reduction  of  1...  In  fact,  as  we  discussed  in  sections  4.1  and  4.2, 
ij 

there  are  always  some  approximations  involved  in  adjusting  the  input  rate 

by  the  window  strategy.  Therefore  some  difference  between  r..  and  r..(real) 

13  13 

should  always  be  anticipated.  In  this  respect, Fig.  4.2  (and  also  Fig.  4.3 
to  be  discussed  later)  are  somewhat  misleading. 

In  our  discussion  in  this  report,  we  have  assumed  so  far  that  the 
desired  input  rate  is  known  by  the  source  node  i.  While  this  assump¬ 

tion  is  reasonable  for  a  static  case,  for  the  quasi-static  case  in  which 
changes  with  time,  the  assumption  may  not  be  valid  any  longer.  When 
node  i  is  updating  r^ ,  if  it  does  not  know  what  is  going  to  be, 

it  should  anticipate  some  increase  in  the  load  offered  by  the  commodity , » 


and  choose  the  value  of  r^  accordingly,  Eq,  (4,13), therefore, changes  to 


(real) 


r  „  (real)  -  y  5^  >_  0 


*  0  (real)  -  u  6  <_  0  (4.14) 

If  rij  as  coraPute<^  by  (4.14)  is  larger  than  ,  the  actual  input  rate 

11  2 
r  (real)  will  be  less  than  r . . .  Since  in  the  next  iteration, r . .  is  compu- 
ij  iJ  ij  p 

ted  based  on  r^(real),  it  will  be  kept  closed  to  ^^y  Fig.  4.3  illustra¬ 
tes  how  r..  and  r  , (real)  change  according  to  (4.12)  and  (4.14),  namely, 
when  -t  is  not  known  by  node  i. 

In  summary,  we  have  shown  in  this  section  that  under  quasi-static  vari¬ 
ations  of  input  statistics  and  when  the  offered  load  K.  is  not  known  bv 

ij 

the  source  node  i,  the  JFCR  strategy  can  still  be  implemented  and  practiced. 
The  essential  question  of  whether  it  can  adapt  fast  enough  to  keep  up  with 
the  changing  input  statistics  is,  however,  difficult  and  requires  further 
research.  Clearly, in  order  to  keep  up  with  faster  statistical  variations, 
the  algorithm  needs  to  be  updated  more  frequently.  But  frequent  updating 
requires  more  updating  protocol  which  reduces  the  effective  link  capacities 
available  for  data.  It  also  makes  the  measurement  of  marginal  link  delays 
and  other  involved  variables  less  accurate. 


4.4  Statistical  Fluctuations  of  the  Input  Arrivals  -  Buffer  Overflow 
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(i,k),  namely  D^>  remains  less  than  B  ,  where  is  some  fraction  of 

the  total  available  buffer  space  B^^(max) .  This  does  not  imply  that  at 

any  instant  of  time,  the  number  of  packets  at  each  link  (i,k)  is  less  than 

B  or  even  less  than  B  (max) . 
ik  1K 

In  order  to  see  this  clearly,  let  us  consider  an  example  in  which  the 
packets  of  eqch  commodity,  at  the  point  where  they  are  admitted  by  the  flow 
control  device  into  the  network,  form  a  poisson  process.  In  this  case  it 
is  possible,  although  very  unlikely,  that  while  the  expected  number  of 
packets  allowed  to  the  network  is  kept  at  a  limited  value  by  the  JFCR  stra¬ 
tegy,  a  huge  number  of  packets  enter  the  network  in  a  short  period  of  time 
in  which  case  buffer  overflow  becomes  inevitable  at  least  at  some  of  the 
nodes.  The  probability  of  such  an  event  can  be  reduced  by  choosing  smaller 
values  for  Bik/B^(max) ,  but  will  always  remain  nonzero.  We  conclude  that 
the  JFCR  strategy  is  only  capable  of  reacting  to  sufficiently  slow  variations 
of  the  input  traffic  and  can  not  control  the  more  dynamic  statistical  fluctu¬ 
ations  of  the  input. 

This  inability  to  control  the  short-term  statistical  variations  of  the 
traffic  is  inherent  in  the  working  mechanism  of  the  JFCR  strategy.  As  the 
congestion  builds  up  in  the  buffer  of  some  link  (i,k) ,it  takes  some  times 
until  the  news  value  of  D  is  measured  and  the  congestion  is  noticed  by 
the  algorithm.  It  may  even  take  several  iterations  until  sufficient  reduc¬ 
tion  is  introduced  by  the  algorithm  in  the  flow  of  traffic  through  link 
(i,k).  If  the  congestion  builds  up  rapidly,  however,  before  these  arrange- 


As  we  shall  see,  this  can  not  happen  if  the  window  strategy  is  employed  as 
the  means  of  adjusting  the  input  rates.  However,  we  consider  this  case 
in  order  to  investigate  the  dynamic  behavior  of  the  JFCR  strategy  alone. 
The  effect  of  the  window  strategy  will  be  discussed  later. 
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ments  are  made,  the  buffer  may  overflow. 

This  limitation  of  the  JFCR  strategy  indicates  that  other  flow  control 
schemes  with  faster  dynamics  should  be  implemented  together  with  it.  The 
window  strategy  that  was  proposed  as  a  mechanism  of  adjusting  the  input  rates 
for  implementation  of  the  JFCR  strategy,  in  fact  is  very  effective  in  con¬ 
trolling  short-term  fluctuations  of  the  arriving  traffic  as  we  will  see. 

The  window  stategy  at  any  time  allows  only  a  limited  number  of  out¬ 
standing  messages  for  each  commodity.  This,  in  comparison  with  the  example 
that  was  just  considered,  is  a  big  imporvement,  since  now  large  bursts  of 
arriving  traffic  which  are  going  to  create  congestion  will  be  smoothed  out 
over  time  by  the  window  strategy  before  being  allowed  to  enter  the  network. 
Moreover,  if  congestion  builds  up  at  some  buffer  of  the  network,  the  input 
rate  of  the  traffic  passing  through  that  buffer  will  be  cut  back  since  these 
commodities  undergo  larger  amount  of  delays  before  reaching  their  destina¬ 
tions.  This  can  be  viewed  as  a  negative  feedback  effect,  in  which  as  con¬ 
gestion  builds  up,  messages  arrive  at  their  destinations  more  slowly, 
corresponding  acknowledgments  come  back  to  the  source  node  with  a  slower 
rate,  and  the  input  rate  is  cut  back  accordingly. 

It  is  clear  at  this  point  that  the  proposed  window  strategy  does  not 
simply  function  as  a  mechanism  of  implementing  the  JFCR  strategy  but  rather 
plays  a  distinct  and  important  dynamic  flow  control  role  in  the  network. 

It  is  even  helpful  to  view  the  window  strategy  as  the  basis  of  our  proposal 
for  flow  control  with  the  JFCR  strategy  playing  the  following  two  roles: 
First  a  complementary  role  in  determining  the  appropriate  window  sizes 
based  on  the  quasi-static  input  statistics,  and  second,  the  role  of  optimal 
routing  of  the  data  in  the  network. 
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The  argument  about  the  effectiveness  of  the  window  strategy  in  conges¬ 
tion  control  does  not  mean,  however,  that  the  network  is  protected  against 
congestion  completely.  The  number  of  outstanding  messages  permitted  by  the 
window  strategy  is  such  that  on  the  average  the  number  of  messages  waiting 
on  each  link  (i,k)  is  less  than  But  a&ain,  the  distribution  of  the 

outstanding  messages  on  different  nodes  has  a  statistical  nature  and  it  is 
possible  that  many  messages  cluster  at  one  node  creating  buffer  overlow. 

The  advantage  of  the  window  strategy  is  in  making  such  events  very  unlikely 
Out  the  likelihood  remains  nonzero  if  the  windows  are  large  enough. 

The  likelihood  of  buffer  overflow  in  a  network  where  the  window  strate¬ 
gy  is  implemented  (with  the  window  sizes  determined  by  the  JFCR  strategy), 
depends  on  several  factors.  First  comes  the  value  of  B^/  B^  ^max^  for 
different  links .  As  this  ratio  is  reduced,  the  likelihood  of  buffer  overflow 
at  the  corresponding  link  decreases.  At  the  limit,  it  is  always  possible  to 
choose  a  sufficiently  small  value  for  B  /B^  (max)  which  totally  prevents 
buffer  overflow  at  link  (i,k).  However,  this  either  would  result  in  very 
inefficient  utilization  of  the  available  capacity  of  link  (i,k)  (if  B ^  is 

JL 

small  )  or  would  require  unreasonably  costly  buffer  assignment  (if  B^max) 
is  very  large) . 

Another  important  factor  in  determining  the  likelihood  of  buffer  over¬ 
flow  in  the  network  is  the  size  of  the  network  and  the  number  of  links  which 
a  message  has  to  pass  through  before  arriving  at  the  destination.  As  the 
communication  path's  get  longer  (in  terms  of  the  number  of  links  involved), 
the  chance  of  congestion  increases.  To  see  this  point  clearly  consider  a 

X 

Recall  from  example  2.1  that  assuming  M/M/1  queues  at  any  link  (i,k),  the 
effective  capacity  of  the  link  would  be  *  ctk  •  Bik/a  +  6  ik)  ’ 
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commodity  which  has  only  one  path  to  the  destination  with  n  links.  Let 
w  indicate  the  corresponding  window  size  and  for  simplicity  assume  instant¬ 
aneous  acknowledgments.  If  n  ■  1  ,  namely,  if  there  is  only  one  link  which 
this  commodity  has  to  go  through,  the  number  of  packets  waiting  at  this  link 
is  always  w  and  therefore  it  never  exceeds  the  anticipated  average  quanti¬ 
ty  which  is  w.  On  the  other  hand  if  n  *  20,  assuming  that  all  of  the  in¬ 
volved  links  have  the  same  average  delay  per  message,  the  anticipated  avera¬ 
ge  number  of  messages  waiting  on  each  link  is  —  ,  while  the  range  of 
fluctuations  of  the  waiting  messages  is  between  0  and  w.  Here .obviously  we 
have  more  chance  of  congestion  unless  B  ^(max)  is  much  bigger  than  B  ^ 
for  all  of  these  links. 

Finally,  we  need  to  emphasize  that  in  a  well-designed  network,  together 
with  any  quasi-static  and  dynamic  flow  control  scheme  (such  as  the  JFCR 
strategy  and  the  window  strategy),  the  system  must  have  some  emergency 
mode  of  operation  in  it,  which  becomes  active  whenever  the  potential  for 
deadlock  arises.  Some  intersting  discussions  of  deadlock  recovery  systems 
can  be  found  in  [1]  and  [2]. 

4 . 5  Node-to-Node  versus  End- to -End  Flow  Control 

In  this  last  section,  we  introduce  a  rather  general  type  of  flow  control 
in  comparison  with  what  was  discussed  previously.  In  the  approach  just  pre¬ 
sented,  flow  control  was  viewed  merely  as  an  end  to  end  practice.  According¬ 
ly,  we  tried  to  maintain  a  noncongesting  traffic  by  imposing  restrictions  on 
the  traffic,  only  at  the  gates  of  the  network.  This  is  not  the  only  type  of 
flow  control  which  can  be  practiced,  nor  is  it  always  sufficiently  effective 
for  the  purpose  of  avoiding  congestion  while  using  the  network  efficiently, 
as  we  showed  in  the  previous  section.  A  more  general  type  of  flow  control  is 
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to  impose  restrictions  on  the  traffic  on  a  node-to-node  basis.  Of  course, 
to  be  precise  we  should  indicate  that  minimum  cost  routing  itself  is  a  type 
of  node-to-node  flow  control  which  tries  to  maintain  some  sort  of  balance  in 
the  level  of  saturation  of  different  links,  so  that  local  congestion  does  not 
occur.  But  in  the  same  way  that  the  input  rate  assignments  of  the  JFCR  stra¬ 
tegy  were  only  successful  in  coping  with  the  long-run  variations  of  the 
traffic  and  not  with  its  short-run  fluctuations,  the  routing  assignments  are 
only  helpful  in  maintaining  balanced  traffic  on  the  long-run,  and  do  not 
effect  the  problem  of  local  congestion  due  to  the  fast  fluctuations  of  traffic. 

In  order  to  provide  protection  against  local  congestion  created  by 
fast  fluctuations  of  traffic,  a  window  strategy  on  a  node  to  node  basis 
might  be  used.  Presumably  the  link  flow  assignments  of  the  JFCR  strategy 
should  be  used  to  determine  the  right  size  of  the  node-to-node  windows, 
in  which  case  the  node-to-node  window  sizes  could  be  interpreted  as  a 
mechanism  of  implementing  these  routing  assignments. 

The  extreme  of  node-to-node  flow  control  is  that  over  any  link  (k,£), 
and  for  every  commodity  (i,j)  using  that  link,  there  be  a  window  size 
w^(i,j)  assigned  to  node  l.  This  scheme  is  very  costly,  however,  and  it 
may  be  desirable  to  practice  node-to-node  flow  control  with  less  generality. 

To  see  the  possibility  of  such  a  scheme,  recall  from  section  4.4  that  as 
the  length  of  a  communication  path  (in  terms  of  the  number  of  links  involved) 
increases,  the  chance  of  local  congestion  grows.  This  reveals  a  more  tract¬ 
able  way  of  viewing  and  practicing  node-to-node  flow  control  •'  As  the  size 
of  a  network  grows,  it  can  be  split  into  smaller  subnetworks  with  the  pro¬ 
posed  end-to-end  flow  control  strategy  practiced  for  each  network. 

Further  research  is  necessary  to  evaluate  the  need  for  node-to-node 
flow  control  and  de"elop  the  theory  and  details  of  an  appropriate  strategy. 
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APPENDIX  A 


Proof  of  Lemma  2.2 

*  * 

Assume  that  at  the  optimal  point  (r  ,f  )  there  is  an  active  route 

R  (i,j)  with  the  length  A  (i,1)  >  A...  By  definition  there  should  be  at 
a  a  Ij 

least  one  route  R^(i,j)  with  the  length  A^(i,j)  «  A  .  Consider  the  traffic 
travelling  from  node  i  to  node  j  over  route  Ra(i,j).  Let  us  change  the 
routing  by  sending  a  small  part  of  this  traffic,  say  e  bits  per  second, 
over  R^(i,j)  and  call  the  new  point  (r  .f).  Therefore, 

*  ~  **  *"■  *  * 

J(r  ,f)  -  J (r, f  )  »  GT(r  ,f)  -  GT(r,f  )  = 

£  t8*k(f*k  +£)"  Hk<f*k)]  +  2-[8U(fAk)  "  8Lk(fAk  •  e)] 

all  links (l, k)  all  links  U,k) 

in  Vi#j)  in  R  (i, j ) 

a 


Since  the  cost  functions  ^ (f^ ,  (£,k)ei,  are  twice  differentiable  at 

it 

f^k>  we  can  use  the  first  order  Taylor  expansion  as  follows: 


J(r 


k  k 

J(r  ,f  ) 


d*lk(f  4k> 


all  links  (£,k) 
in  R^(i,j) 


d  f, 


ilk 


dgilk(£ilk) 

^  d  fick 
all  links  (£,k) 

in  Ra(i , j) 


£+  0(e2) 


■  A,  (i,j)  •  e  -  A  (i,j)  .  e  +  0(e2)  =  (A..  -  A  (i» j) )  •  e  +  0(e2) 

D  a  Ij  » 

k  ~  it  k 

Then  for  a  sufficiently  small  value  of  t,  J(r  ,f)  -  J(r  ,f  )  becomes  negative 

k  k 

which  contradicts  the  assumption  that  (r  ,f  )  is  an  optimal  point.  Therefore 

k  k 

at  the  optimal  point  (r  ,f  ),  the  length  of  any  active  route  R(i,j)  is  A  . 


V.*, 

•<e*r 
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Next  consider  any  commodity  (i,j)eCA  and  suppose  r  <  , 

Let  R(i,j)  be  any  route  with  the  length  \ ...  Let  us  define  a  new  point 
—  * 

(r,f)  by  increasing  r_  slightly  and  sending  the  increased  part  of  r_  over 
route  R(i,j).  Using  an  argument  similar  to  the  above,  we  can  show  that 


1  Pij  (rij  ) 


r..  <  * 


(A.  1) 


Similarly  if  r  >  0,  take  any  active  route  R(i,j)  over  which  part  of 
the  nodal  flow  s ^ ^  is  passing.  Define  a  new  point  (r,f)  by  decreasing  r_ 
slightly  and  reflecting  this  decrease  only  in  the  flow  passing  over  R(i,j). 
Then  in  a  similar  way  it  is  possible  to  show  that 


X..  <  P..(r  .  ) 

ij  -  ‘  ij  ij 


r .  .  >0 

ij 


(A.  2) 


Q.E.D. 


Combining  (A.l)  and  (A. 2),  Eq.  (2.2)  follows. 


Proof  of  Sufficiency  of  Theorem  2.1  : 


First  we  establish  the  following  lemma: 


Lemma  A. 1  For  any  feasible  points  (r  ,f  )  which  satisfies  conditions  of 
theorem  2.1  and  any  other  feasible  point  (r,f),  the  following  inequality 


holds  true  with  equality  if  (r,f)  *  (r  ,f  ) 


2  fik(j)  8ik  (fik  }  -  (i5cC  rij  Bij 


(A. 3) 


(i.k)eL 

j  cM 

Proof:  Multiply  both  sides  of  (2.4)  by  f  ^(j)  to  get 

> +  V  '  £ikU)  i  sij  £ik°>  (1'k)a'  <A-4> 

★ 

(A.  4)  becomes  an  equality  for  f^(j)  =  f^  ( j ) ,  since  in  this  case  either 
fik  (j)  >  0  or  f^CJ)  *  0.  Summing  up  (A. 4)  over  i,k  and  j  we  get: 
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2Vf ‘k>-fik<J>  P  ^ 


si3 


(i,k)£i 

j€.V 


(.i,k)el 

jeA/ 


(i,k)ei. 

jeAl 


3«3  £ik«> 


E  »«  E 


i.j 


-  E  eki  Z  £ik<J> 


k:  (i,k)c,L 


k,  j 


i:  (i,k)eL 


i.j 


E  £ik<3>  -  E 


f  mi 

mi 


k:  (i,k)£i. 


m:  (m, i)sL 


ZB.  .r.  .  Z  6.  .  r.  . 

ij  ij  =  ij  ij 

i.j  (iJ)eC. 


with  equality  in  (^)  for  f  =  f  . 


Q.E.D. 


Now  let  there  be  a  set  of  positive  numbers  S  satisfying  (2.4)  and  (2.5) 
*  * 

at  a  feasible  point  (r  ,f  ).  For  any  other  feasible  point  (r, f)  and  any 
0  <  a  <  1,  (ar  +  (1  -a)r*,  af  +  (1  -  a)f*)  is  also  a  feasible  point.  Define 

•jlf  ^ 

J  (a)  ■  J(ar  +  (1  -a)r  ,  af  +  (1  -a)f  ).  Since  J(a)  is  a  convex  function, 
J(r,  f )  -  J  (r*  ,  f*  )  -  J(l)  -  J(0) 

a*  0 


Z  t<rij"rij  3  ?ij(rij  )]  +  23  t(fik(j>  -  fikU))8'<k<0 


(i.J)eC, 


ik' 


ik' 


(i.k )cL 

jeM 


According  to  (A. 3) 


/ 

>-  Z  t(rij-rij)  Pij(rij)]  +  z 


(i.j)eC, 


(i, j )cC , 


r . .8  .  . 

ij  ij 


(i,j)eC. 


ik  ik 


k 

r  £ 
ij  ij 


fl.DtC. 


<rij  -  rlj)(W  '  B«> 


ij-  ”  E  <cij  -  V<p1j<rij>  -6ij)  + 

(i. j)cCA 
*  « 
rij=° 


Z  -  rij)<pij(Tij)  _eij)  +  23  -  rij)(pij(rij)  -  "ij} 


(i’/)eCA 
0<r . ,<  -t.  . 
ij  ij 


(i.j)eC 

r  -A .  :4 

ij  1J 
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1 


According  to  (2.5), the  second  summation  above  is  zero,  and  the  other  two 
summations  are  both  positive  since  0  r^.  <_  ,(i,j)eC A»  Therefore, 

J (r , f)  -  J(r*,f*)  >0  for  all  feasible  (r,f).  Q.E.D. 


APPENDIX  B 


We  prove  theorem  3.5  through  establishing  the  following  3  lemmas: 

Lemma  B , 1  :  Let  Jq  be  any  positive  number.  There  are  scale  factors 

y  >  0  and  n  >  0  such  that  for  any  feasible  point  (r°,$°)  satisfying 

J(r0,4>°)  <  J  ,  we  have: 

—  o 

JCr1,^1)  -  J(r°,<P°)<  0  for  all  (r1,61)eA(r°,!{>0) 

Proof:  First  consider  the  point  (r1,^0)  *  Ar(r°,'}>0)  and  let  us  define 
ra  =  a.  r1  +  (1  -  a)  r°  and  J(a)  *  J(ra,cf!0)  ,  0  <_  a  <  1.  Since  J(r,6)  is 

twice  differentiable  in  terms  of  r,  J(a)  is  also  twice  differentiable  in 
terms  of  a.  Therefore  from  the  Taylor  remainder  theorem: 


•J (a)  - 

A 

J (0)  *  a* 

dJ  (a) 

1  1-2  d  2  J  (a ) 

(B.l) 

da  I 

|a-0  2*  da2 

*  * 

0<a  <a 

dJ  (a) 
da 

-  z 

(i.J tCA 

(ri ' 

-  r°  )  -2i- 

«  3rij 

r*ra 

(B.2) 

L 

(i.J)eC. 


(tij  •  riV 


E  o 

a,m)  eCA' 


r°  ) 


d2J 


Zm  £m 


5rtm  3rlj 


r=r 

(B.3) 


’.13)  and  (3 . li)  that : 
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o  \  s  1/1  o  v  2 

'  rij  ~  ‘  U(rij  "  ij} 


r  «r 

ij  ij 


It  follows  from  (B . 2)  and  05.4)  that: 


(B.  4) 


<y m  < .  I  y  ^  _  r°  >2 

da  -  u  ^  v  ij  ij  ’ 

a*=0  (i,j)eC 


(B.5) 


Next  let  us  define  the  bound  as: 

o 


i i d  J(r ,6)  i , 

Mj  «  max  j  j - 2~  1  ' 

o  dr 

(r,$):J(r,*)<J 
2  ^  0 

where  ^  ’ -  -  is  the  Hessian  of  J(r,$)  with  respect  to  r,  considering  r  as 

dr  ^2^  ,  A .  ^ 

a  vector  (the  order  of  components  r  in  r  is  not  Important)  and  |  j - }~  - )  J 

2j  r  j  dr" 

is  defined  as  max  vC.  d  .  v  over  all  vectors  v  of  proper  dimension 

dr" 

and  magnitude  one.  The  bound  MT  exists  since  J(r,<j>)  is  twice  differentiable 

u 

in  terms  of  r  for  J(r,d>)  <  °°.  It  follows  from  (B,3)  that  given  J(a)  <_  Jo: 


<  M,  .  £  (r1.  -  r ° 

da2  Jo  (i,j)cCA  ij 


o  ,2 


(B.  6) 


We  know  that  J(0)  =  J(r°,<f°)  <  J  .  Take  any  a£[0,l]  satisfying: 

—  o 

A 

j(a)  <_  J(p)  for  aefQ,a]  . 

According  to  (B.l),  (B.5)  and  (B.6): 

J  (a)  -  J(0)  <  £  Cr 2  -  rii)-2  [~  +  -^1 

"U,j )eC4  13  ij  L  y  2  o 


(B .  7) 


(B.8) 


For  u<  2/Kj  and  ae[0,l]  the  R.H.S.  of  (B.8)  is  negative,  therefore 

/.  J°  10 
J(a)  <_  J(0)  with  strict  inequality  i£  r  i1  r  ,  Since  J(0)  <_  JQ,  it  follows 

/V  /N 

that  (B. 7)  is  true  for  any  0  <  a  <  1.  Taking  a  *  1  we  have  the  following 
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with  equality  if  and  only  if  r1  *  r°; 


J(l)  -  J(0) 


J (r1,^0) 


J(r°,*°)  < 


E  <r 

L(i,  j  )eC, 


ij 


o  ,2 

V 


ci  “j  -  ba> 

o 


(B,9) 


Finally,  let  us  consider  the  effect  of  the  mapping  A,  on  the  cost  J. 

Y 

Let  (r1 ,6°) .  Since  G^r1^0)  <  J(rU°)  <  Jq,  it  follows  from 

Gallager  [A],  Appendix  C,  that  there  exists  an  ri  >  0  such  that 

-UrM1)  -  JCr1^0)  -  G  (t**1)  -  G  (r^-.i0)! - — — -  y  £2(j)  s  2  <  0 

2n(N-l)3  f-  J  ^  " 


where  ( j ) 


L 

k: (i,k)eL 


Aik  (j) 


i.jeJ* 


(B.10) 


and  A  (j)  and  s  are  the  values  corresponding  to  point  (r1,^0).  Summing  up 

IK  ij 

(B.9)  and  (B.10)  we  get  J(r*,$^)  -  J(r°,<{>0)  £  0. 

Q.E.D. 

Lemma  B.2  Let  the  scale  factors  y  and  ri  be  chosen  as  required  by  lemma  B,1 

for  some  given  value  Jq  and  let  (r°, t°)be  any  feasible  point  which  does  not 

minimize  (3.6)  and  J(r0,<j>0)  <  J  .  Then 

—  o 

•J(rN  1 ,0N  1)  <  J (r°,$°)  for  all  (rN~\<iN‘’1)eAN"1(r0,(j>0)  (B.ll) 

Proof:  Consider  any  point  (rN-1,^N  AN-1  (r°  .  Let  (rn,<t>n),  n  *  l,..,N-2, 

by  any  sequence  of  points  satisfying: 


(rnf$n)eA(rI1“1,*n~1X  n  =  1,2, . .  ,N-1 

It  follows  from  Eq.  (B.9)  and(B.lO)  that: 

J (rn,<tn)  <  J Crn , cj>  <  J (rn_1,  <Jn_1)  n  -  x,..,N^l 


Therefore,  the  only  case  in  which  (B,ll)  does  not  hold  is  when  we  have: 

J (rn,ifn)  -  JCr0^""1)  -  JCr11'1,  (j)11"1)  n-lf...  N-l  (B.12) 

We  show  this  can  happen  only  if  (r°,  <f>°)  minimizes  (3.6),  contrary  to  our 
assumption: 

Let  (B.12)  hold  true.  It  follows  then  from  (B.9)  and  (B.10)  that 
rN~^  *  r^  ^  *  . . .  =  r°  and  at  any  point  (rn  ^)  ■  (r°,<J>n  ,  n*l,..,N-l, 

AikX  (j)  •  Sij1  =  0  i  *  J  (B.  13) 

where  A1?,  ^  is  the  value  defined  by  Eq.  (17)  -  (19.)  corresponding  to  the 
mapping  of  point  (r°,<{in  ^)  to  point  (r°,$n).  We  show  first  that  if  (B.13) 
holds, there  can  be  no  blocking  for  the  mapping  of  (r°,s>n  ^)  into  (r°,i})n) 
for  n  *  1....N-1.  If  any  blocking  occurs,  there  is  some  i,m,j  for  which 
(3.15)  and  (3.16)  is  satisfied  (with  >.  ).  Thus  s^.1  >  0  and  ^^(j)  >  0. 

3Gt  9GT  n-l 

Also  from  (3.18),  .  <J)  »  ^ >  »'  >  0.  Thus  A  ^  (J )  >  0 

no  jy 

and  ( j )  .  s£j^  >  which  is  in  contradiction  with  (B.13). 

Next  let  us  denote  by  Kn.^(i,j),  n=l..N-l,  the  set  of  points  k 

min 

which  achieve  the  minimization  in  Eq.  (3.18)  at  the  point  (r°,<J>n  ).  It  can 

be  seen  from  Eq.  (3.18)  -  (3.20)  that  4>^(j)  is  nonzero  only  if  (i,j). 

This  is  because,  according  to  (B.13),  either  (i)“  0  or  s?j^  *  0.  If 

AikX  (j)  *  °»  Eq*  (3*18>  and  (3.19)  imply  chat  either  teKain(i,  j )  ,or  i>  J"1  (j  )-0 

in  which  case  ^^(j)  *  ~Aik  ( 3  )  *0-  0n  tlie  other  hand  if  5  1  =  0, 

it  follows  from  Eq,  (3.18)  and  (3.19)  that  either  (i,j)  or 
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*n  which  case(j>^(j)  *<j>^lj)  -  a"u^(J)  *  0.  Thus  in  all 


'  ik ' 


'ik 


cases  4*  (j )  is  nonzero  only  for  (i,j). 


iK  ""  'r  ik 
ik' 

Now  consider  a  fixed  destination  j  in  the  network  and  let  us  de¬ 
note  by  Z  (j)  the  set  of  nodes  i  which  are  m  bops  away  from  j  on  a 
shortest  route  R(i,j)  with  g^  (f^)  considered  as  the  length  of  link 
(k,f,).  Notice  that  according  to  (B,13>  the  link  flows  are  the  same  for  all 
of  the  points  (r°,<J>n  ^),n  =  1,..N;  therefore  the  shortest  routes  and  the 
sets  I  (j)  are  identical  at  different  steps  of  algorithm  A.  From  our  previous 
result  ,  for  any  ieli(j),  6^(3)  >  0  only  if  kef^^(i,J).  Since  (i,j)  in  this 
case  is  a  shortest  route  from  i  to  j ,  it  alsc  follows  that  at  (r°,  <*Z), 

3Gt  SGt 

« —  *  X...  One  can  also  see  that  r -  remains  the  same  in  the  next 

«  J  o  n  « 

steps  of  A  namely  at  (r  ,$  ) ,  n  ■  2,..N-1,  Next  we  know  that  for  any 

iel2(j),  (j)  >  0  only  if  keK*in  (i,j).  By  definition  of  I2(j),  at  least 

1  o  2 

one  element  of  ( i ,  j )  belongs  also  to  I^(j).  Therefore  at  (r  ,$  ) , 


3G, 


3r 


ij 

3G„ 


—  3  X^.  We  can  continue  this  argument  to  show  that  at  (r°,<t>N  ^), 


X  for  all  nodes  ieN,  since  no  node  can  be  more  than  N-l  hops  away 


3r .  . 
ij 

from  j.  Thus  it  follows  from  Theorem  3.4  that  (r  )  minimizes  (3.6). 

Since  by  assumption  J(.r°,<f>°)  *  J(r°,<f>^  ^),(r°,<!>0)  also  minimizes  (3.6). 

Thus  we  have  shown  that  (B.ll)  fails  to  hold  only  if  (B.12)  holds  and  (B.12) 
holds  only  when  (r°,  <f>°)  minimizes  (3.6),  Q.E.D. 

Lemma  B . 3  The  mapping  A  is  a  closed  mapping  (in  the  sense  defined  in  page 
124  of  [15]). 


Proof:  First  notice  from  (3.13)  and  (3.14)  that  A^  is  a  continuous  point 
to  point  mapping.  Thus  according  to  corollary  2,  p,  125  of  [15],  in  order 
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to  verify  lemma  B,3  we  only  need  to  show  that  A  is  a  closed  point  to  set 
mapping. 


Let  (r,<fn)  be  a  sequence  of  feasible  points  of  (3.6)  converging 

n 

to  (r,<$>).  Take  any  (i,k)el  and  jeN  ,  i  +  j ,  and  let  aik(j)  be  value  • 

A 

of  a^Cj)  at  (r,^)  as  defined  by  (3.18)  for  any  possible  choice  of  and 

let  a^  (j)  -*■  aik(j)-  Let  us  denote  by  Yim(j)  and  y"m  (j),  the  value  of 

,  3Gt 

g.  (f.  )  +  ^ -  respectively  at  (r,<$)  and  (r,  4>  ).  According  to  theorem 

im  im  o  v 

mj 

3.2  ,  y.  (j)  is  continuous  in  (r ,$);  therefore  (j)  y  (j)  for  all 
xm  im  xm 

(i,m)eL.  Since  a^k  (j)  approaches  a  limit,  it  follows  from  (3.18)  that 

min  ya  (j)  also  approaches  a  limit,  which  for  a  subsequence  of  n  must 

mi  8° 

ij 

be  achieved  at  some  particular  m.  Since  this  m  is  not  blocked  for  the 

subsequence,  it  can  be  considered  not  blocked  at  (r,$) .  Similarly,  if  there 

is  any  node  Z  which  is  blocked  and  yn.  (j)  <  min  y11  (j)  for  this  sub- 

lx*  ah 

“^ij 

sequence  of  n,  Z  can  also  be  blocked  for  (r ,$).  Therefore,  the  mapping 
from  (r,<t>)  to  a^(j)  is  a  closed  mapping.  Furthermore, since  s^.  is  continu¬ 
ous  in  (r,<J)),p  .  Is  also  a  closed  point  to  set  mapping  from  (r,4) 

for  s..  >0.  Finally  since  0  <  <p..  (j)  <  1  ,  it  follows  from  (3.19)  that 

IJ  ~ “  IK  ~ “ 

A^(j)  is  a  closed  point  to  set  mapping  for  arbitrary  s^  ,  Thus  from  (3.17) 


and  (3.20),  A^  is  a  closed  point  to  set  mapping. 


Q.E.D. 


Proof  of  Theorem  3.5  Let  us  defins  5  as  the  set  of  points  (r,<f)  which  are 
feasible  for  (3.6)  and  J(r,<£)  <_  Jq,  i.e, 

S  ■  {(r,4>)|  0  <  r.,  <  n...  ,  (i,j)eC  ,<t>  is  a  routing  variable  set, 

ij  ij  a 

J(r,<b)  <  Jq  ) 
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Since  S  is  a  compact  set  and  A  is  a  closed  mapping  from  $  into  itself, 

w_l 

it  follows  from  corollary  1,  p.  124  of  [15]  that  A  is  also  a  closed 

mapping.  Theorem  3.5  now  follows  from  lemma  B.2  and  the  general  convergence 

N— 1 

theorem,  p.  125  of  115],  using  A  as  the  algorithm. 


Proof  of  Theorems  3 ■ 7  and  3 . 8 


First  notice  from  Eq. 
ing  nodal  flow  in  network  M, 
follows: 


(3.21.c)  chat  s  is  equal  to  the  correspond- 
The  routing  variables  of  network  M  are  as 


V<J> 


fik^J) 


*ik<3> 

5  .  . 

ij 


^ik^J) 


(i,k)£  L 


’ii 


4^  r  (j  )  k*j  , 


k#j , 


(i,k)eCA 

(i,k)eCA 


Therefore, each  set  4>  uniquely  specifies  the  routing  variables  and  the  multi- 
commodity  flows  of  network  M  ,  which  in  turn  correspond  to  a  unique  point 
(r,f)  (Th.  3.2).  Thus  theorem  3.7  is  verified. 

To  prove  theorem  3.8,  consider  the  routing  algorithm  of  [17]  for 
network  KT  .  We  shall  introduce  a  slight  modification  in  this  algorithm  to 
come  up  with  algorithm  A^  :  In  order  to  satisfy  constraint  (3,3,d),  for  every 
(.i,j)eCA,  we  shall  define  the  set  of  blocked  nodes  F^(j)of  network  U  to 
also  include  all  links  (i,k'),  k  ^  j.  This  extension  in  the  definition  of 
!(j)  does  not  effect  the  proof  of  convergence  in  [17],  Furthermore,  accord¬ 
ing  to  corollary  3.1,  any  limit  point  of  the  algorithm  with  the  above 
extension  in  F.  (j),  is  still  an  optimal  point  for  the  routing  problem  3.1. 


Next  notice  that  for  every  node  i  and  destination  j  ,  wit-  the 


extended  set  F^(j),  the  following  routing  variables  of  network  ,  are  always 
zero  during  the  algorithm! 


^ik(J>  *  0 

\k’(J)  "  0 


k eM  ,  (i,k )fL 

k  ^  j  ,  (i,k)eC 


The  subproblem  (2.9)  of  117]  can  accordingly  be  simplified  by  dropping  the 
terms  corresponding  to  the  above  routing  variables.  What  remains  is  the 
same  as  the  algorithm  discussed  in  section  3.4.  Therefore,  according  to 
theorem  3.1  and  the  convergence  theorem  of  [17],  there  exists  an  a  >  0  for 

which  algorithm  A,  converges  to  a  solution  of  (2.1).  Furthermore,  accord- 

V 

ing  to  [16]  ,  the  JFCR  variable  set  *  A™  fy0)  corresponds  to  a  loop-free 


routing  for  all  m  «  1,2,3,... 


Q.E.D. 


APPENDIX  C 


Proof  of  Theorem  4.1 


dh  3n^ 

First  we  show  that  the  matrix  P  *  —  (with  entries  P,  *  t — ) 

drv  *cin  3rm 


is  nonsingular  for  r zD.  We  know  that  f^»  ]Ca-kJl'rk’  ^or 

k*l 

It  follows  then  from  (4.3)  that: 


.L. 


3tt, 

3rm 


L  3t*  L  dt* 


q.  •M>qt  k,m-l, . . .  K 
nk  m 


(C.l) 


where  q^  denotes  the  transpose  of  q^  and  M  is  an  LxL  diagonal  matrix 

dt ; 

with  the  entries  K  »  on  the  diagonal.  Also  it  follows  from 

XrXr  at  £ 
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(4.5)  that: 


3nk 


3rk 


km  *  3rm  *  r‘rk'3r, 


m 


+(Tk+9k)l 

ID 


kiha 


k*m 


(C.2) 


Therefore  if  P^  denotes  the  k’th  row  of  P,  we  have  from  (C.l)  and  (C.2) 
that 


pk "  7(Tk+V*ek +  FVVM(qi ;  q2 1  •*•14] 


(C.3) 


where  e^dR  is  a  row  vector  with  one  in  the  k'th  place  and  zero  in  other 
places.  Notice  that  the  last  matrix  in  (C.3)  is  QC.  Finally  it  follows 
from  (C.3)  that: 


P  -  T  +  R.Q-M-Q 


(C.4) 


where  T  and  R  are  KxK  diagonal  matrices,  respectively  with  the  entries 
X k+@k  rk 

Tkk  *  — f —  and  Rkk  *  ™  on  the  diagonal. 

In  order  to  show  that  P is  a  nonsingular  matrix,  we  consider  the 
following  two  cases : 

Case  a  —  r^>0,  k»l,2,...K: 

In  this  case  P  can  be  expressed  in  the  following  form: 


Tk+®k 


(C.5) 


on  the 


P  *  R(Tr  +  Q-M-Qt) 

r  f 

where  T  is  a  diagonal  KxK  matrix  with  the  entries  T.  .  = 

‘k 

diagonal.  Since  T^>0  for  k«l,...K,  Tr  is  a  positive  definite  matrix. 

K 

Since  M  is  a  diagonal  matrix  with  nonnegative  entries,  for  any  xe]R 


xt.(Q-M-Qt)-x  -  (Q^x)*  •  M  •  (QC-x)  •>,  0 


we  have: 
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Therefore  Q-M'Q1’  is  positive  seraidefinite .  It  follows  that  Tr  +  Q*M*QC 
is  positive  definite,  and  thus  nonsingular.  Since  R  is  also  nonsingular 
in  this  case,  it  follows  from  (C.5)  that  ?  is  nonsingular  and  det.  P>0. 

Case  b  —  r^-0  f°r  some  commodities: 

For  any  k  with  rk*0,  the  corresponding  row  in  the  matrix  R-Q’M*Qt 
is  zero.  It  follows  then  from  Eq.  (C.4)  that  for  any  k  with  rk=0,  the 

9k+rk 

corresponding  row  of  P  only  has  the  diagonal  entry  ■  — p — .  Let  us 
construct  a  matrix  P  by  eliminating  the  k'th  row  and  the  k'th  column  of 
P  for  all  k  with  rk*0.  It  can  be  seen  from  (C.4)  that: 

P  -  T  +  R-Q-M-QC 

where  T  and  R  are  constructed  by  eliminating  the  corresponding  rows  and 

A 

columns  of  T  and  R,  and  Q  is  constructed  by  eliminating  the  corresponding 
rows  of  Q.  Since  R  has  only  nonzero  elements  on  the  diagonal,  according 
to  Case  l,det  p>0.  Therefore, 

*  ®k+Tk 

det  P  *  det  P  •  II  (  ~ )  >  0 

all  k 
with  rk*0 

Therefore  the  matrix  P  *  ^  Is  nonsingular  for  any  vzD.  It  follows 

dr 

from  the  implicit  function  theorem  [19]  that  for  any  point  r qzD  and 
n  *  h(r  ),  there  exist  small  spheres  I |r-r  I  I <e  ,  I In-n  II <6  in  which 
there  is  a  one  to  one  correspondence  between  r  and  n.  Furthermore,  the 
resulting  implicit  function  r  *  h  ^(n)  is  continuously  differentiable  on 
h(Z?)  and  its  derivative  with  respect  to  n  is  P  ^ . 

-4*  •+ 

Notice  that  the  one  to  one  correspondence  between  r  and  n,  as 


claimed  in  theorem  4.1,  is  a  stronger  condition  than  we  have  established 
up  to  here.  In  order  to  complete  the  proof  of  theorem  4.1,  we  need  to 
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show  that  the  one  to  one  correspondence  between  r  and  n  is  valid  in  the 
whole  region  D  and  h (Z7) .  To  do  so,  let  us  consider  two  arbitrary 
points  r  and  r'  in  D.  Let  n  *  h(r)  and  n'  *  h(r').  Similarly  in  the 

■f  . 

following,  any  parameter  which  is  primed,  corresponds  to  the  imput  r  . 
We  have  from  Eq.  (4.5)  that: 


-  \  ■  r[rk(,k+6k>  -  VW1 


7t(ck-ck'  ‘  (,k+V  +  rk(,k-,k>1 


(C.6) 


From  Eq.  (4.3)  we  have: 


Tk  '  Tk  ~  ^  qkit’  ^s/fi/  “ 
£.=■1 


(C.7) 


According  to  the  mean  value  theorem,  for  each  link  l,  there  exists  a 


point  f*  on  the  line  segment  connecting  f^  and  f^  such  that: 


A-  n" (f; 


(C.8) 


It  follows  from  (C.7)  and  (C.8)  that 


Tk  "  Tk 


£  “kt  ’  d£f/t-ft ' 


>C”'  dt£  /  t.-*-, 

’2*  *  If ~L  r*  •  9,(r  -r) 

1*1  k£  dh/frf*  1 


(C  .9) 


K  K 

If  xelR  andt'e®  are  column  vectors  made  of  components  and  we  see 
from  (C.9)  that 


t’  -  T  -  Q-M* •Qt • (r'-r) 


(C.10) 


*  *  dt£  / 
where  M  is  an  LxL  diagonal  matrix  with  diagonr-'  entries 
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Finally  from  (C.6)  and  (.C.JO)  we  conclude  that: 


n'  -  n  -  (T'+R  ■  Q-  M  •  Q  )  •  (r'-r) 


(C.ll) 


Now  consider  the  matrix  P*  *  T'+R,Q,M*'Qt-  P*  is  the  same  as  P 

dt£  * 

except  that  the  parameters  t,  ,  k*l,...K,  and  -rr—  ,  2.»1...L,  in  matrix  p 

k  df£ 

are  evaluated  at  different  points  on  the  line  segment  connecting  r  and  r', 

rather  than  being  calculated  at  the  same  point.  However,  P  is  also  a 

nonsingular  matrix.  This  is  because,  in  the  process  of  proving  the 

nonsingularity  of  P,  only  the  structure  of  P and  the  fact  that  the  para- 

dtj. 

meters  T^,  k*l,...K,  are  strictly  positive  and  the  parameters  ,  £*1...L, 
are  nonnegative  were  used.  Since  p*  shares  all  of  these  properties 
with  P,  the  same  argument  can  be  restated  for  P*  to  prove  that  it  is 
nonsingular.  Therefore  from  (C.ll): 


n'  -  n 


O-^r'-r  =0 


Q.E.D. 


Case  2  -  ,  (i, j) e^: 

We  use  an  example  in  this  case  to  show  that  when  (i,j)eC^, 

there  can  be  multiple  sets  of  input  rates  r  corresponding  to  the  same 
vector  n.  Consider  the  network  of  Fig.  C.l  with  two  active  commodities 
r^(from  node  2  to  node  5)  and  ^  (from  node  4  to  node  1).  Let  half  of  r^ 
take  the  links  (2,4)  and  (4,5)  and  the  other  half  take  (2,3),  (3,4)  and 
(4,5);  but  assume  that  acknowledgments  all  take  the  route  (5,4),  (4,3)  and 

(3.2) .  Similarly  let  half  of  take  (4,2)  and  (2,1)  and  the  other 
half  take  (4,3),  (3,2)  and  (2,1);  but  assume  that  the  acknowledgments 
all  take  the  route  (1,2),  (2,3)  and  (3,4).  Let  the  capacities  of  links 

(1.2) ,  (2,1),  (4,5)  and  (5,4)  be  large  enough  so  that  the  delay  of  these 
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links  is  negligible.  Let  the  other  links  all  have  capacity  C  and  the  delay 
function  t(f)  *  — ^  .  With  these  assumptions  we  have: 


3 


Fig.  C.l 


T,  -  0.5  • 

1  C-r 


1 

9  l  ,  1  ,  2 

1  C-r^  C-r2  C-r2 


—  +  0.5  ■  (+1  *= 

C*-r^  C-r.  C-r, 


Similarly:  and  @2  >■ 


Therefor.:  ^ 


and 


-  /  1.5  .  2  s 

n2  “  r2  C-r 2  +  C-r^ 


If  we  further  assume  that  r  +r2  *  4"  C»it  follows  that: 

rlr2 


nl  "  n2  *  2 (C-r. )  (C-r,) 


(c .12) 


If  we  interchange  the  values  of  and  r2,  a  =  (n^,n2)  will  remain  the 
same.  Therefore,  in  this  case  r  =  (r^,r2)  and  r'  *  (r2,r^)  both 
correspond  to  the  same  n,  if  r^+r2  *  \  ^ • 
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It  is  not  difficult  to  find  the'  matrix  P 


-3r  in  this  case, 
dr 


Similar  to  Eq.  (C.l),  one  can  easily  conclude  from  (4.7)  that: 


t 

— £  -  v.  •  M  •  q„ 
3r  k  m 

m 


k,m»l, . . .K 


From  (C.l)  and  (C.13)  we  have 


(C.13) 


3r 


(vk+qk) 


(C .14) 


m 

Using  Eq.  (4.5)  and  (C.14),  one  can  proceed  in  a  manner  similar  to  the 


previous  case  to  find  that: 


P  =*  T+R(Q+V)  *  M  •  Q* 


(C .15) 


where  V  is  a  KxL  matrix  composed  of  rows  v^. 

For  the  network  of  Fig.  C.l  it  is  possible  to  deduce  from  (C.12) 
that  p  is  singular  at  r^^  -  r2  *  |  C,  without  computing  p  from  (C.15) . 
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